2023-09-17 20:01:09,746 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-17 20:01:09,973 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963 2023-09-17 20:01:09,973 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-17 20:01:09,973 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-17 20:01:10,013 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-17 20:01:10,248 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-17 20:01:10,249 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7, deleteOnExit=true 2023-09-17 20:01:10,249 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-17 20:01:10,249 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/test.cache.data in system properties and HBase conf 2023-09-17 20:01:10,250 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop.tmp.dir in system properties and HBase conf 2023-09-17 20:01:10,250 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop.log.dir in system properties and HBase conf 2023-09-17 20:01:10,251 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-17 20:01:10,251 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-17 20:01:10,251 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-17 20:01:10,574 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-17 20:01:10,579 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-17 20:01:10,579 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-17 20:01:10,579 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-17 20:01:10,580 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-17 20:01:10,580 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-17 20:01:10,580 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-17 20:01:10,581 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-17 20:01:10,581 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-17 20:01:10,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-17 20:01:10,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/nfs.dump.dir in system properties and HBase conf 2023-09-17 20:01:10,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir in system properties and HBase conf 2023-09-17 20:01:10,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-17 20:01:10,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-17 20:01:10,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-17 20:01:11,102 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-17 20:01:11,107 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-17 20:01:11,430 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-17 20:01:11,621 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-17 20:01:11,635 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 20:01:11,676 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 20:01:11,711 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir/Jetty_localhost_46497_hdfs____.fvonuu/webapp 2023-09-17 20:01:11,859 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46497 2023-09-17 20:01:11,871 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-17 20:01:11,871 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-17 20:01:12,385 WARN [Listener at localhost/36291] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-17 20:01:12,471 WARN [Listener at localhost/36291] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-17 20:01:12,496 WARN [Listener at localhost/36291] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 20:01:12,541 INFO [Listener at localhost/36291] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 20:01:12,548 INFO [Listener at localhost/36291] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir/Jetty_localhost_37921_datanode____.7lapc5/webapp 2023-09-17 20:01:12,643 INFO [Listener at localhost/36291] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37921 2023-09-17 20:01:13,100 WARN [Listener at localhost/38675] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-17 20:01:13,119 WARN [Listener at localhost/38675] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-17 20:01:13,123 WARN [Listener at localhost/38675] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 20:01:13,126 INFO [Listener at localhost/38675] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 20:01:13,136 INFO [Listener at localhost/38675] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir/Jetty_localhost_45659_datanode____z1fkww/webapp 2023-09-17 20:01:13,237 INFO [Listener at localhost/38675] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45659 2023-09-17 20:01:13,249 WARN [Listener at localhost/45839] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-17 20:01:13,267 WARN [Listener at localhost/45839] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-17 20:01:13,272 WARN [Listener at localhost/45839] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 20:01:13,274 INFO [Listener at localhost/45839] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 20:01:13,285 INFO [Listener at localhost/45839] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir/Jetty_localhost_41835_datanode____cqw0h0/webapp 2023-09-17 20:01:13,422 INFO [Listener at localhost/45839] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41835 2023-09-17 20:01:13,444 WARN [Listener at localhost/34359] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-17 20:01:13,778 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2284d672cc96bbd9: Processing first storage report for DS-34478109-4458-4124-9769-6fbf0b62f942 from datanode fb98433f-5757-430a-9d7e-2187cbb0f170 2023-09-17 20:01:13,780 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2284d672cc96bbd9: from storage DS-34478109-4458-4124-9769-6fbf0b62f942 node DatanodeRegistration(127.0.0.1:44427, datanodeUuid=fb98433f-5757-430a-9d7e-2187cbb0f170, infoPort=40485, infoSecurePort=0, ipcPort=38675, storageInfo=lv=-57;cid=testClusterID;nsid=73904547;c=1694980871193), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-17 20:01:13,780 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe3b5c7bb2d4b14ef: Processing first storage report for DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b from datanode 6d2d5653-97ed-440d-9e44-26d7a9e12c2f 2023-09-17 20:01:13,780 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe3b5c7bb2d4b14ef: from storage DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b node DatanodeRegistration(127.0.0.1:38933, datanodeUuid=6d2d5653-97ed-440d-9e44-26d7a9e12c2f, infoPort=39971, infoSecurePort=0, ipcPort=34359, storageInfo=lv=-57;cid=testClusterID;nsid=73904547;c=1694980871193), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-17 20:01:13,780 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2bcd3273914ee58a: Processing first storage report for DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa from datanode 2dc8d76b-8e73-4c09-9ace-55754103c6d3 2023-09-17 20:01:13,780 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2bcd3273914ee58a: from storage DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa node DatanodeRegistration(127.0.0.1:39725, datanodeUuid=2dc8d76b-8e73-4c09-9ace-55754103c6d3, infoPort=38977, infoSecurePort=0, ipcPort=45839, storageInfo=lv=-57;cid=testClusterID;nsid=73904547;c=1694980871193), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-17 20:01:13,780 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2284d672cc96bbd9: Processing first storage report for DS-7815ba56-7cbe-4a09-8192-fdec90a71ec4 from datanode fb98433f-5757-430a-9d7e-2187cbb0f170 2023-09-17 20:01:13,780 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2284d672cc96bbd9: from storage DS-7815ba56-7cbe-4a09-8192-fdec90a71ec4 node DatanodeRegistration(127.0.0.1:44427, datanodeUuid=fb98433f-5757-430a-9d7e-2187cbb0f170, infoPort=40485, infoSecurePort=0, ipcPort=38675, storageInfo=lv=-57;cid=testClusterID;nsid=73904547;c=1694980871193), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-17 20:01:13,780 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe3b5c7bb2d4b14ef: Processing first storage report for DS-ffed4961-8d3f-4e42-a70e-fa5c09a8cc87 from datanode 6d2d5653-97ed-440d-9e44-26d7a9e12c2f 2023-09-17 20:01:13,781 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe3b5c7bb2d4b14ef: from storage DS-ffed4961-8d3f-4e42-a70e-fa5c09a8cc87 node DatanodeRegistration(127.0.0.1:38933, datanodeUuid=6d2d5653-97ed-440d-9e44-26d7a9e12c2f, infoPort=39971, infoSecurePort=0, ipcPort=34359, storageInfo=lv=-57;cid=testClusterID;nsid=73904547;c=1694980871193), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-17 20:01:13,781 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2bcd3273914ee58a: Processing first storage report for DS-d97d3459-bbbd-4c14-9889-6c42a12adf6f from datanode 2dc8d76b-8e73-4c09-9ace-55754103c6d3 2023-09-17 20:01:13,781 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2bcd3273914ee58a: from storage DS-d97d3459-bbbd-4c14-9889-6c42a12adf6f node DatanodeRegistration(127.0.0.1:39725, datanodeUuid=2dc8d76b-8e73-4c09-9ace-55754103c6d3, infoPort=38977, infoSecurePort=0, ipcPort=45839, storageInfo=lv=-57;cid=testClusterID;nsid=73904547;c=1694980871193), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-17 20:01:13,959 DEBUG [Listener at localhost/34359] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963 2023-09-17 20:01:14,047 INFO [Listener at localhost/34359] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/zookeeper_0, clientPort=62829, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-17 20:01:14,066 INFO [Listener at localhost/34359] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62829 2023-09-17 20:01:14,080 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:14,083 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:14,787 INFO [Listener at localhost/34359] util.FSUtils(471): Created version file at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c with version=8 2023-09-17 20:01:14,788 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/hbase-staging 2023-09-17 20:01:15,270 INFO [Listener at localhost/34359] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-17 20:01:15,733 INFO [Listener at localhost/34359] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-17 20:01:15,767 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:15,767 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:15,767 INFO [Listener at localhost/34359] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-17 20:01:15,767 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:15,768 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-17 20:01:15,910 INFO [Listener at localhost/34359] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-17 20:01:15,983 DEBUG [Listener at localhost/34359] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-17 20:01:16,076 INFO [Listener at localhost/34359] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46221 2023-09-17 20:01:16,089 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:16,091 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:16,115 INFO [Listener at localhost/34359] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46221 connecting to ZooKeeper ensemble=127.0.0.1:62829 2023-09-17 20:01:16,175 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:462210x0, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-17 20:01:16,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46221-0x100bb7ad6d00000 connected 2023-09-17 20:01:16,205 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 20:01:16,206 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 20:01:16,219 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-17 20:01:16,227 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46221 2023-09-17 20:01:16,227 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46221 2023-09-17 20:01:16,228 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46221 2023-09-17 20:01:16,228 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46221 2023-09-17 20:01:16,229 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46221 2023-09-17 20:01:16,235 INFO [Listener at localhost/34359] master.HMaster(444): hbase.rootdir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c, hbase.cluster.distributed=false 2023-09-17 20:01:16,303 INFO [Listener at localhost/34359] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-17 20:01:16,303 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:16,303 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:16,304 INFO [Listener at localhost/34359] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-17 20:01:16,304 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:16,304 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-17 20:01:16,309 INFO [Listener at localhost/34359] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-17 20:01:16,312 INFO [Listener at localhost/34359] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35419 2023-09-17 20:01:16,315 INFO [Listener at localhost/34359] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-17 20:01:16,321 INFO [Listener at localhost/34359] mob.MobFileCache(124): MobFileCache disabled 2023-09-17 20:01:16,323 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:16,324 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:16,328 INFO [Listener at localhost/34359] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35419 connecting to ZooKeeper ensemble=127.0.0.1:62829 2023-09-17 20:01:16,334 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:354190x0, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-17 20:01:16,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35419-0x100bb7ad6d00001 connected 2023-09-17 20:01:16,336 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 20:01:16,337 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 20:01:16,338 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-17 20:01:16,339 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35419 2023-09-17 20:01:16,339 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35419 2023-09-17 20:01:16,340 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35419 2023-09-17 20:01:16,341 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35419 2023-09-17 20:01:16,345 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35419 2023-09-17 20:01:16,358 INFO [Listener at localhost/34359] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-17 20:01:16,358 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:16,358 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:16,359 INFO [Listener at localhost/34359] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-17 20:01:16,359 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:16,359 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-17 20:01:16,359 INFO [Listener at localhost/34359] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-17 20:01:16,361 INFO [Listener at localhost/34359] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45281 2023-09-17 20:01:16,361 INFO [Listener at localhost/34359] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-17 20:01:16,363 INFO [Listener at localhost/34359] mob.MobFileCache(124): MobFileCache disabled 2023-09-17 20:01:16,364 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:16,367 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:16,371 INFO [Listener at localhost/34359] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45281 connecting to ZooKeeper ensemble=127.0.0.1:62829 2023-09-17 20:01:16,376 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:452810x0, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-17 20:01:16,377 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): regionserver:452810x0, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 20:01:16,378 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): regionserver:452810x0, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 20:01:16,379 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): regionserver:452810x0, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-17 20:01:16,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45281-0x100bb7ad6d00002 connected 2023-09-17 20:01:16,380 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45281 2023-09-17 20:01:16,380 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45281 2023-09-17 20:01:16,380 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45281 2023-09-17 20:01:16,385 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45281 2023-09-17 20:01:16,385 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45281 2023-09-17 20:01:16,397 INFO [Listener at localhost/34359] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-17 20:01:16,397 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:16,398 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:16,398 INFO [Listener at localhost/34359] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-17 20:01:16,398 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-17 20:01:16,398 INFO [Listener at localhost/34359] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-17 20:01:16,398 INFO [Listener at localhost/34359] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-17 20:01:16,399 INFO [Listener at localhost/34359] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41855 2023-09-17 20:01:16,400 INFO [Listener at localhost/34359] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-17 20:01:16,401 INFO [Listener at localhost/34359] mob.MobFileCache(124): MobFileCache disabled 2023-09-17 20:01:16,402 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:16,403 INFO [Listener at localhost/34359] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:16,405 INFO [Listener at localhost/34359] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41855 connecting to ZooKeeper ensemble=127.0.0.1:62829 2023-09-17 20:01:16,412 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:418550x0, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-17 20:01:16,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41855-0x100bb7ad6d00003 connected 2023-09-17 20:01:16,413 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 20:01:16,414 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 20:01:16,415 DEBUG [Listener at localhost/34359] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-17 20:01:16,415 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41855 2023-09-17 20:01:16,417 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41855 2023-09-17 20:01:16,417 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41855 2023-09-17 20:01:16,421 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41855 2023-09-17 20:01:16,421 DEBUG [Listener at localhost/34359] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41855 2023-09-17 20:01:16,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:01:16,432 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-17 20:01:16,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:01:16,453 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-17 20:01:16,453 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-17 20:01:16,454 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:01:16,453 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-17 20:01:16,453 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-17 20:01:16,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-17 20:01:16,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46221,1694980874966 from backup master directory 2023-09-17 20:01:16,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-17 20:01:16,461 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:01:16,462 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-17 20:01:16,462 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-17 20:01:16,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:01:16,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-17 20:01:16,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-17 20:01:16,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/hbase.id with ID: 6cbb8557-7499-4937-8ad5-8856c322b17a 2023-09-17 20:01:16,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-17 20:01:16,624 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:01:16,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x48768fb9 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:16,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48706250, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:16,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-17 20:01:16,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-17 20:01:16,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-17 20:01:16,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-17 20:01:16,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-17 20:01:16,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-17 20:01:16,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 20:01:16,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/data/master/store-tmp 2023-09-17 20:01:16,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:16,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-17 20:01:16,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 20:01:16,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 20:01:16,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-17 20:01:16,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 20:01:16,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 20:01:16,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-17 20:01:16,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/WALs/jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:01:16,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46221%2C1694980874966, suffix=, logDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/WALs/jenkins-hbase4.apache.org,46221,1694980874966, archiveDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/oldWALs, maxLogs=10 2023-09-17 20:01:16,938 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK] 2023-09-17 20:01:16,938 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK] 2023-09-17 20:01:16,938 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK] 2023-09-17 20:01:16,948 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-17 20:01:17,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/WALs/jenkins-hbase4.apache.org,46221,1694980874966/jenkins-hbase4.apache.org%2C46221%2C1694980874966.1694980876880 2023-09-17 20:01:17,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK], DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK], DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK]] 2023-09-17 20:01:17,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-17 20:01:17,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:17,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-17 20:01:17,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-17 20:01:17,091 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-17 20:01:17,099 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-17 20:01:17,127 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-17 20:01:17,140 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:17,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-17 20:01:17,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-17 20:01:17,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-17 20:01:17,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:17,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68221450, jitterRate=0.01657882332801819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:01:17,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-17 20:01:17,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-17 20:01:17,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-17 20:01:17,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-17 20:01:17,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-17 20:01:17,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-17 20:01:17,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-09-17 20:01:17,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-17 20:01:17,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-17 20:01:17,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-17 20:01:17,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-17 20:01:17,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-17 20:01:17,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-17 20:01:17,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-17 20:01:17,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-17 20:01:17,313 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:01:17,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-17 20:01:17,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-17 20:01:17,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-17 20:01:17,333 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-17 20:01:17,333 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-17 20:01:17,333 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-17 20:01:17,334 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:01:17,333 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-17 20:01:17,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46221,1694980874966, sessionid=0x100bb7ad6d00000, setting cluster-up flag (Was=false) 2023-09-17 20:01:17,350 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:01:17,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-17 20:01:17,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:01:17,365 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:01:17,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-17 20:01:17,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:01:17,375 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp 2023-09-17 20:01:17,425 INFO [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(951): ClusterId : 6cbb8557-7499-4937-8ad5-8856c322b17a 2023-09-17 20:01:17,426 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(951): ClusterId : 6cbb8557-7499-4937-8ad5-8856c322b17a 2023-09-17 20:01:17,427 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(951): ClusterId : 6cbb8557-7499-4937-8ad5-8856c322b17a 2023-09-17 20:01:17,433 DEBUG [RS:0;jenkins-hbase4:35419] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-17 20:01:17,433 DEBUG [RS:2;jenkins-hbase4:41855] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-17 20:01:17,433 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-17 20:01:17,442 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-17 20:01:17,442 DEBUG [RS:2;jenkins-hbase4:41855] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-17 20:01:17,442 DEBUG [RS:0;jenkins-hbase4:35419] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-17 20:01:17,442 DEBUG [RS:2;jenkins-hbase4:41855] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-17 20:01:17,442 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-17 20:01:17,442 DEBUG [RS:0;jenkins-hbase4:35419] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-17 20:01:17,451 DEBUG [RS:2;jenkins-hbase4:41855] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-17 20:01:17,453 DEBUG [RS:0;jenkins-hbase4:35419] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-17 20:01:17,459 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-17 20:01:17,461 DEBUG [RS:2;jenkins-hbase4:41855] zookeeper.ReadOnlyZKClient(139): Connect 0x17fe48f2 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:17,462 DEBUG [RS:0;jenkins-hbase4:35419] zookeeper.ReadOnlyZKClient(139): Connect 0x7e33bcb9 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:17,462 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ReadOnlyZKClient(139): Connect 0x4ec81448 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:17,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-17 20:01:17,475 DEBUG [RS:2;jenkins-hbase4:41855] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1939a47d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:17,475 DEBUG [RS:1;jenkins-hbase4:45281] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@400fe3e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:17,476 DEBUG [RS:2;jenkins-hbase4:41855] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d062382, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-17 20:01:17,476 DEBUG [RS:1;jenkins-hbase4:45281] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44307f38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-17 20:01:17,500 DEBUG [RS:0;jenkins-hbase4:35419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70f45d0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:17,501 DEBUG [RS:0;jenkins-hbase4:35419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74cbd7c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-17 20:01:17,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:17,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-17 20:01:17,531 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41855 2023-09-17 20:01:17,531 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45281 2023-09-17 20:01:17,531 DEBUG [RS:0;jenkins-hbase4:35419] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35419 2023-09-17 20:01:17,539 INFO [RS:0;jenkins-hbase4:35419] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-17 20:01:17,539 INFO [RS:1;jenkins-hbase4:45281] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-17 20:01:17,540 INFO [RS:1;jenkins-hbase4:45281] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-17 20:01:17,539 INFO [RS:2;jenkins-hbase4:41855] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-17 20:01:17,540 INFO [RS:0;jenkins-hbase4:35419] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-17 20:01:17,540 INFO [RS:2;jenkins-hbase4:41855] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-17 20:01:17,540 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-17 20:01:17,540 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-17 20:01:17,540 DEBUG [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-17 20:01:17,541 INFO [RS:1;jenkins-hbase4:45281] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:17,541 INFO [RS:0;jenkins-hbase4:35419] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:17,541 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1022): About to register with Master. 2023-09-17 20:01:17,541 INFO [RS:2;jenkins-hbase4:41855] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:17,542 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1022): About to register with Master. 2023-09-17 20:01:17,541 DEBUG [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1022): About to register with Master. 2023-09-17 20:01:17,545 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46221,1694980874966 with isa=jenkins-hbase4.apache.org/172.31.14.131:41855, startcode=1694980876397 2023-09-17 20:01:17,545 INFO [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46221,1694980874966 with isa=jenkins-hbase4.apache.org/172.31.14.131:35419, startcode=1694980876302 2023-09-17 20:01:17,545 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46221,1694980874966 with isa=jenkins-hbase4.apache.org/172.31.14.131:45281, startcode=1694980876357 2023-09-17 20:01:17,567 DEBUG [RS:1;jenkins-hbase4:45281] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-17 20:01:17,567 DEBUG [RS:2;jenkins-hbase4:41855] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-17 20:01:17,567 DEBUG [RS:0;jenkins-hbase4:35419] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-17 20:01:17,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-17 20:01:17,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-17 20:01:17,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-17 20:01:17,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-17 20:01:17,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-17 20:01:17,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-17 20:01:17,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-17 20:01:17,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,624 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35067, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-17 20:01:17,624 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39941, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-17 20:01:17,624 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54971, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-17 20:01:17,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694980907626 2023-09-17 20:01:17,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-17 20:01:17,635 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-17 20:01:17,635 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46221] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-17 20:01:17,636 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-17 20:01:17,641 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-17 20:01:17,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-17 20:01:17,646 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46221] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-17 20:01:17,649 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46221] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-17 20:01:17,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-17 20:01:17,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-17 20:01:17,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-17 20:01:17,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-17 20:01:17,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-17 20:01:17,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-17 20:01:17,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-17 20:01:17,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-17 20:01:17,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-17 20:01:17,669 DEBUG [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(2830): Master is not running yet 2023-09-17 20:01:17,669 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(2830): Master is not running yet 2023-09-17 20:01:17,669 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(2830): Master is not running yet 2023-09-17 20:01:17,669 WARN [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-17 20:01:17,669 WARN [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-17 20:01:17,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694980877669,5,FailOnTimeoutGroup] 2023-09-17 20:01:17,669 WARN [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-17 20:01:17,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694980877670,5,FailOnTimeoutGroup] 2023-09-17 20:01:17,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-17 20:01:17,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,689 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-17 20:01:17,690 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-17 20:01:17,690 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:17,713 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:17,716 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-17 20:01:17,719 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/info 2023-09-17 20:01:17,719 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-17 20:01:17,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:17,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-17 20:01:17,723 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/rep_barrier 2023-09-17 20:01:17,724 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-17 20:01:17,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:17,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-17 20:01:17,727 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/table 2023-09-17 20:01:17,728 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-17 20:01:17,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:17,730 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740 2023-09-17 20:01:17,731 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740 2023-09-17 20:01:17,734 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-17 20:01:17,736 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-17 20:01:17,744 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:17,745 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59915507, jitterRate=-0.1071893721818924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-17 20:01:17,745 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-17 20:01:17,745 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-17 20:01:17,745 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-17 20:01:17,745 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-17 20:01:17,746 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-17 20:01:17,746 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-17 20:01:17,748 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-17 20:01:17,748 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-17 20:01:17,754 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-17 20:01:17,754 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-17 20:01:17,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-17 20:01:17,771 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46221,1694980874966 with isa=jenkins-hbase4.apache.org/172.31.14.131:41855, startcode=1694980876397 2023-09-17 20:01:17,771 INFO [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46221,1694980874966 with isa=jenkins-hbase4.apache.org/172.31.14.131:35419, startcode=1694980876302 2023-09-17 20:01:17,771 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46221,1694980874966 with isa=jenkins-hbase4.apache.org/172.31.14.131:45281, startcode=1694980876357 2023-09-17 20:01:17,777 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46221] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:17,782 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46221] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:17,784 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:17,784 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46221] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:17,784 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:17,784 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36291 2023-09-17 20:01:17,784 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36291 2023-09-17 20:01:17,784 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-17 20:01:17,785 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-17 20:01:17,786 DEBUG [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:17,786 DEBUG [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36291 2023-09-17 20:01:17,786 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-17 20:01:17,786 DEBUG [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-17 20:01:17,789 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-17 20:01:17,792 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 20:01:17,798 DEBUG [RS:2;jenkins-hbase4:41855] zookeeper.ZKUtil(162): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:17,798 WARN [RS:2;jenkins-hbase4:41855] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-17 20:01:17,798 INFO [RS:2;jenkins-hbase4:41855] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 20:01:17,798 DEBUG [RS:0;jenkins-hbase4:35419] zookeeper.ZKUtil(162): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:17,799 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:17,799 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ZKUtil(162): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:17,799 WARN [RS:0;jenkins-hbase4:35419] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-17 20:01:17,799 WARN [RS:1;jenkins-hbase4:45281] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-17 20:01:17,799 INFO [RS:0;jenkins-hbase4:35419] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 20:01:17,799 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41855,1694980876397] 2023-09-17 20:01:17,800 INFO [RS:1;jenkins-hbase4:45281] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 20:01:17,800 DEBUG [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:17,800 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:17,800 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45281,1694980876357] 2023-09-17 20:01:17,800 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35419,1694980876302] 2023-09-17 20:01:17,814 DEBUG [RS:0;jenkins-hbase4:35419] zookeeper.ZKUtil(162): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:17,814 DEBUG [RS:2;jenkins-hbase4:41855] zookeeper.ZKUtil(162): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:17,814 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ZKUtil(162): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:17,815 DEBUG [RS:0;jenkins-hbase4:35419] zookeeper.ZKUtil(162): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:17,815 DEBUG [RS:2;jenkins-hbase4:41855] zookeeper.ZKUtil(162): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:17,815 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ZKUtil(162): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:17,815 DEBUG [RS:0;jenkins-hbase4:35419] zookeeper.ZKUtil(162): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:17,815 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ZKUtil(162): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:17,815 DEBUG [RS:2;jenkins-hbase4:41855] zookeeper.ZKUtil(162): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:17,827 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-17 20:01:17,827 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-17 20:01:17,827 DEBUG [RS:0;jenkins-hbase4:35419] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-17 20:01:17,837 INFO [RS:1;jenkins-hbase4:45281] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-17 20:01:17,837 INFO [RS:2;jenkins-hbase4:41855] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-17 20:01:17,838 INFO [RS:0;jenkins-hbase4:35419] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-17 20:01:17,862 INFO [RS:0;jenkins-hbase4:35419] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-17 20:01:17,864 INFO [RS:1;jenkins-hbase4:45281] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-17 20:01:17,864 INFO [RS:2;jenkins-hbase4:41855] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-17 20:01:17,867 INFO [RS:2;jenkins-hbase4:41855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-17 20:01:17,867 INFO [RS:1;jenkins-hbase4:45281] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-17 20:01:17,868 INFO [RS:2;jenkins-hbase4:41855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,867 INFO [RS:0;jenkins-hbase4:35419] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-17 20:01:17,868 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,868 INFO [RS:0;jenkins-hbase4:35419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,869 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-17 20:01:17,869 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-17 20:01:17,869 INFO [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-17 20:01:17,878 INFO [RS:0;jenkins-hbase4:35419] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,878 INFO [RS:2;jenkins-hbase4:41855] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,878 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,878 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,878 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,878 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-17 20:01:17,879 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-17 20:01:17,879 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,880 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,880 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,879 DEBUG [RS:2;jenkins-hbase4:41855] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,880 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,880 DEBUG [RS:0;jenkins-hbase4:35419] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,880 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-17 20:01:17,880 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,880 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,880 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,880 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-17 20:01:17,882 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,882 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,882 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,885 INFO [RS:2;jenkins-hbase4:41855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,885 INFO [RS:2;jenkins-hbase4:41855] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,885 INFO [RS:2;jenkins-hbase4:41855] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,889 INFO [RS:0;jenkins-hbase4:35419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,889 INFO [RS:0;jenkins-hbase4:35419] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,889 INFO [RS:0;jenkins-hbase4:35419] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,906 INFO [RS:1;jenkins-hbase4:45281] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-17 20:01:17,906 INFO [RS:2;jenkins-hbase4:41855] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-17 20:01:17,906 INFO [RS:0;jenkins-hbase4:35419] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-17 20:01:17,909 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45281,1694980876357-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,909 INFO [RS:0;jenkins-hbase4:35419] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35419,1694980876302-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,909 INFO [RS:2;jenkins-hbase4:41855] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41855,1694980876397-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:17,935 INFO [RS:1;jenkins-hbase4:45281] regionserver.Replication(203): jenkins-hbase4.apache.org,45281,1694980876357 started 2023-09-17 20:01:17,935 INFO [RS:0;jenkins-hbase4:35419] regionserver.Replication(203): jenkins-hbase4.apache.org,35419,1694980876302 started 2023-09-17 20:01:17,936 INFO [RS:2;jenkins-hbase4:41855] regionserver.Replication(203): jenkins-hbase4.apache.org,41855,1694980876397 started 2023-09-17 20:01:17,936 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45281,1694980876357, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45281, sessionid=0x100bb7ad6d00002 2023-09-17 20:01:17,936 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41855,1694980876397, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41855, sessionid=0x100bb7ad6d00003 2023-09-17 20:01:17,936 INFO [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35419,1694980876302, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35419, sessionid=0x100bb7ad6d00001 2023-09-17 20:01:17,936 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-17 20:01:17,936 DEBUG [RS:0;jenkins-hbase4:35419] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-17 20:01:17,936 DEBUG [RS:2;jenkins-hbase4:41855] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-17 20:01:17,937 DEBUG [RS:2;jenkins-hbase4:41855] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:17,936 DEBUG [RS:0;jenkins-hbase4:35419] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:17,936 DEBUG [RS:1;jenkins-hbase4:45281] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:17,937 DEBUG [RS:0;jenkins-hbase4:35419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35419,1694980876302' 2023-09-17 20:01:17,937 DEBUG [RS:2;jenkins-hbase4:41855] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41855,1694980876397' 2023-09-17 20:01:17,938 DEBUG [RS:2;jenkins-hbase4:41855] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-17 20:01:17,938 DEBUG [RS:0;jenkins-hbase4:35419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-17 20:01:17,938 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45281,1694980876357' 2023-09-17 20:01:17,938 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-17 20:01:17,939 DEBUG [RS:0;jenkins-hbase4:35419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-17 20:01:17,939 DEBUG [RS:2;jenkins-hbase4:41855] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-17 20:01:17,939 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-17 20:01:17,939 DEBUG [RS:0;jenkins-hbase4:35419] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-17 20:01:17,939 DEBUG [RS:0;jenkins-hbase4:35419] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-17 20:01:17,939 DEBUG [RS:2;jenkins-hbase4:41855] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-17 20:01:17,940 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-17 20:01:17,940 DEBUG [RS:2;jenkins-hbase4:41855] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-17 20:01:17,940 DEBUG [RS:0;jenkins-hbase4:35419] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:17,940 DEBUG [RS:2;jenkins-hbase4:41855] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:17,940 DEBUG [RS:2;jenkins-hbase4:41855] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41855,1694980876397' 2023-09-17 20:01:17,940 DEBUG [RS:2;jenkins-hbase4:41855] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:17,940 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-17 20:01:17,940 DEBUG [RS:0;jenkins-hbase4:35419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35419,1694980876302' 2023-09-17 20:01:17,941 DEBUG [RS:0;jenkins-hbase4:35419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:17,941 DEBUG [RS:1;jenkins-hbase4:45281] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:17,941 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45281,1694980876357' 2023-09-17 20:01:17,941 DEBUG [RS:2;jenkins-hbase4:41855] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:17,941 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:17,941 DEBUG [RS:0;jenkins-hbase4:35419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:17,942 DEBUG [RS:2;jenkins-hbase4:41855] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-17 20:01:17,942 INFO [RS:2;jenkins-hbase4:41855] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-17 20:01:17,942 INFO [RS:2;jenkins-hbase4:41855] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-17 20:01:17,942 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:17,942 DEBUG [RS:0;jenkins-hbase4:35419] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-17 20:01:17,942 INFO [RS:0;jenkins-hbase4:35419] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-17 20:01:17,942 DEBUG [jenkins-hbase4:46221] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-17 20:01:17,943 INFO [RS:0;jenkins-hbase4:35419] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-17 20:01:17,943 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-17 20:01:17,943 INFO [RS:1;jenkins-hbase4:45281] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-17 20:01:17,944 INFO [RS:1;jenkins-hbase4:45281] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-17 20:01:17,947 DEBUG [jenkins-hbase4:46221] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:01:17,954 DEBUG [jenkins-hbase4:46221] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:01:17,954 DEBUG [jenkins-hbase4:46221] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:01:17,954 DEBUG [jenkins-hbase4:46221] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:01:17,954 DEBUG [jenkins-hbase4:46221] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:01:17,957 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41855,1694980876397, state=OPENING 2023-09-17 20:01:17,965 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-17 20:01:17,967 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:01:17,967 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-17 20:01:17,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:01:18,057 INFO [RS:2;jenkins-hbase4:41855] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41855%2C1694980876397, suffix=, logDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,41855,1694980876397, archiveDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/oldWALs, maxLogs=32 2023-09-17 20:01:18,057 INFO [RS:0;jenkins-hbase4:35419] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35419%2C1694980876302, suffix=, logDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,35419,1694980876302, archiveDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/oldWALs, maxLogs=32 2023-09-17 20:01:18,057 INFO [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45281%2C1694980876357, suffix=, logDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,45281,1694980876357, archiveDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/oldWALs, maxLogs=32 2023-09-17 20:01:18,083 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK] 2023-09-17 20:01:18,083 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK] 2023-09-17 20:01:18,083 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK] 2023-09-17 20:01:18,095 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK] 2023-09-17 20:01:18,095 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK] 2023-09-17 20:01:18,095 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK] 2023-09-17 20:01:18,097 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK] 2023-09-17 20:01:18,097 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK] 2023-09-17 20:01:18,097 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK] 2023-09-17 20:01:18,098 INFO [RS:2;jenkins-hbase4:41855] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,41855,1694980876397/jenkins-hbase4.apache.org%2C41855%2C1694980876397.1694980878061 2023-09-17 20:01:18,103 DEBUG [RS:2;jenkins-hbase4:41855] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK], DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK], DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK]] 2023-09-17 20:01:18,106 INFO [RS:0;jenkins-hbase4:35419] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,35419,1694980876302/jenkins-hbase4.apache.org%2C35419%2C1694980876302.1694980878061 2023-09-17 20:01:18,106 INFO [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,45281,1694980876357/jenkins-hbase4.apache.org%2C45281%2C1694980876357.1694980878061 2023-09-17 20:01:18,109 DEBUG [RS:0;jenkins-hbase4:35419] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK], DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK], DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK]] 2023-09-17 20:01:18,110 DEBUG [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK], DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK], DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK]] 2023-09-17 20:01:18,158 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:18,160 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 20:01:18,163 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 20:01:18,177 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-17 20:01:18,178 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-17 20:01:18,182 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41855%2C1694980876397.meta, suffix=.meta, logDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,41855,1694980876397, archiveDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/oldWALs, maxLogs=32 2023-09-17 20:01:18,203 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK] 2023-09-17 20:01:18,204 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK] 2023-09-17 20:01:18,205 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK] 2023-09-17 20:01:18,210 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/WALs/jenkins-hbase4.apache.org,41855,1694980876397/jenkins-hbase4.apache.org%2C41855%2C1694980876397.meta.1694980878183.meta 2023-09-17 20:01:18,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38933,DS-f2ca9c3f-e002-4ac6-9398-9ae3cd656c1b,DISK], DatanodeInfoWithStorage[127.0.0.1:39725,DS-586b8fdf-f346-4135-b2c1-a1f8789cdeaa,DISK], DatanodeInfoWithStorage[127.0.0.1:44427,DS-34478109-4458-4124-9769-6fbf0b62f942,DISK]] 2023-09-17 20:01:18,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-17 20:01:18,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-17 20:01:18,218 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:18,218 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-17 20:01:18,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-17 20:01:18,222 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-17 20:01:18,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-17 20:01:18,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:18,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-17 20:01:18,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-17 20:01:18,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-17 20:01:18,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/info 2023-09-17 20:01:18,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/info 2023-09-17 20:01:18,243 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-17 20:01:18,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:18,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-17 20:01:18,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/rep_barrier 2023-09-17 20:01:18,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/rep_barrier 2023-09-17 20:01:18,246 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-17 20:01:18,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:18,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-17 20:01:18,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/table 2023-09-17 20:01:18,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/table 2023-09-17 20:01:18,249 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-17 20:01:18,250 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:18,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740 2023-09-17 20:01:18,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740 2023-09-17 20:01:18,259 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-17 20:01:18,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-17 20:01:18,263 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64961774, jitterRate=-0.031994134187698364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-17 20:01:18,266 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-17 20:01:18,275 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694980878149 2023-09-17 20:01:18,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-17 20:01:18,297 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-17 20:01:18,298 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41855,1694980876397, state=OPEN 2023-09-17 20:01:18,300 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-17 20:01:18,301 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-17 20:01:18,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-17 20:01:18,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41855,1694980876397 in 330 msec 2023-09-17 20:01:18,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-17 20:01:18,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 540 msec 2023-09-17 20:01:18,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 801 msec 2023-09-17 20:01:18,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694980878316, completionTime=-1 2023-09-17 20:01:18,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-17 20:01:18,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-17 20:01:18,384 DEBUG [hconnection-0x18c5862a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:18,387 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:18,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-17 20:01:18,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694980938407 2023-09-17 20:01:18,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694980998407 2023-09-17 20:01:18,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 90 msec 2023-09-17 20:01:18,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46221,1694980874966-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:18,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46221,1694980874966-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:18,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46221,1694980874966-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:18,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46221, period=300000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:18,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-17 20:01:18,445 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-17 20:01:18,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-17 20:01:18,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-17 20:01:18,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-17 20:01:18,475 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 20:01:18,479 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 20:01:18,507 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:01:18,514 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235 empty. 2023-09-17 20:01:18,515 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:01:18,515 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-17 20:01:18,570 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-17 20:01:18,573 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 48895dcec4e0ce8835cfb75a33d89235, NAME => 'hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:01:18,595 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:18,595 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 48895dcec4e0ce8835cfb75a33d89235, disabling compactions & flushes 2023-09-17 20:01:18,595 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:01:18,596 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:01:18,596 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. after waiting 0 ms 2023-09-17 20:01:18,596 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:01:18,596 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:01:18,596 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 48895dcec4e0ce8835cfb75a33d89235: 2023-09-17 20:01:18,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 20:01:18,617 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694980878605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980878605"}]},"ts":"1694980878605"} 2023-09-17 20:01:18,649 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-17 20:01:18,651 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 20:01:18,659 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980878652"}]},"ts":"1694980878652"} 2023-09-17 20:01:18,664 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-17 20:01:18,668 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:01:18,670 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:01:18,670 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:01:18,670 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:01:18,670 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:01:18,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=48895dcec4e0ce8835cfb75a33d89235, ASSIGN}] 2023-09-17 20:01:18,675 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=48895dcec4e0ce8835cfb75a33d89235, ASSIGN 2023-09-17 20:01:18,677 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=48895dcec4e0ce8835cfb75a33d89235, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45281,1694980876357; forceNewPlan=false, retain=false 2023-09-17 20:01:18,830 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-17 20:01:18,831 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=48895dcec4e0ce8835cfb75a33d89235, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:18,832 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694980878831"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980878831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980878831"}]},"ts":"1694980878831"} 2023-09-17 20:01:18,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 48895dcec4e0ce8835cfb75a33d89235, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:01:18,992 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:18,992 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 20:01:18,995 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 20:01:19,002 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:01:19,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 48895dcec4e0ce8835cfb75a33d89235, NAME => 'hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235.', STARTKEY => '', ENDKEY => ''} 2023-09-17 20:01:19,003 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. service=AccessControlService 2023-09-17 20:01:19,003 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:19,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:01:19,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:19,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:01:19,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:01:19,009 INFO [StoreOpener-48895dcec4e0ce8835cfb75a33d89235-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:01:19,011 DEBUG [StoreOpener-48895dcec4e0ce8835cfb75a33d89235-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235/info 2023-09-17 20:01:19,011 DEBUG [StoreOpener-48895dcec4e0ce8835cfb75a33d89235-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235/info 2023-09-17 20:01:19,012 INFO [StoreOpener-48895dcec4e0ce8835cfb75a33d89235-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48895dcec4e0ce8835cfb75a33d89235 columnFamilyName info 2023-09-17 20:01:19,012 INFO [StoreOpener-48895dcec4e0ce8835cfb75a33d89235-1] regionserver.HStore(310): Store=48895dcec4e0ce8835cfb75a33d89235/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:19,014 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:01:19,015 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:01:19,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:01:19,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:19,024 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 48895dcec4e0ce8835cfb75a33d89235; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69389212, jitterRate=0.033979833126068115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:01:19,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 48895dcec4e0ce8835cfb75a33d89235: 2023-09-17 20:01:19,027 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235., pid=6, masterSystemTime=1694980878992 2023-09-17 20:01:19,032 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:01:19,032 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:01:19,034 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=48895dcec4e0ce8835cfb75a33d89235, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:19,034 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694980879033"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980879033"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980879033"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980879033"}]},"ts":"1694980879033"} 2023-09-17 20:01:19,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-17 20:01:19,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 48895dcec4e0ce8835cfb75a33d89235, server=jenkins-hbase4.apache.org,45281,1694980876357 in 201 msec 2023-09-17 20:01:19,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-17 20:01:19,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=48895dcec4e0ce8835cfb75a33d89235, ASSIGN in 370 msec 2023-09-17 20:01:19,048 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 20:01:19,048 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980879048"}]},"ts":"1694980879048"} 2023-09-17 20:01:19,051 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-17 20:01:19,056 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 20:01:19,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 595 msec 2023-09-17 20:01:19,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-17 20:01:19,077 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-17 20:01:19,077 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:01:19,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:19,107 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:19,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-17 20:01:19,141 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-17 20:01:19,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-09-17 20:01:19,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-17 20:01:19,170 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-17 20:01:19,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-17 20:01:19,183 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-17 20:01:19,186 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-17 20:01:19,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.725sec 2023-09-17 20:01:19,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-17 20:01:19,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-17 20:01:19,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-17 20:01:19,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46221,1694980874966-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-17 20:01:19,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46221,1694980874966-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-17 20:01:19,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-17 20:01:19,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-17 20:01:19,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 20:01:19,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 20:01:19,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-17 20:01:19,224 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:01:19,225 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2 empty. 2023-09-17 20:01:19,228 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:01:19,228 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-17 20:01:19,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-17 20:01:19,236 DEBUG [Listener at localhost/34359] zookeeper.ReadOnlyZKClient(139): Connect 0x60312a8b to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:19,243 DEBUG [Listener at localhost/34359] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d00d5f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:19,259 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-17 20:01:19,261 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9f997e734cba795e8cbbbb5e1fe66de2, NAME => 'hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:01:19,266 DEBUG [hconnection-0x173cec51-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:19,293 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:19,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:19,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 9f997e734cba795e8cbbbb5e1fe66de2, disabling compactions & flushes 2023-09-17 20:01:19,294 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:01:19,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:01:19,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. after waiting 0 ms 2023-09-17 20:01:19,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:01:19,294 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:01:19,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 9f997e734cba795e8cbbbb5e1fe66de2: 2023-09-17 20:01:19,297 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:01:19,297 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-17 20:01:19,297 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/test.cache.data in system properties and HBase conf 2023-09-17 20:01:19,297 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop.tmp.dir in system properties and HBase conf 2023-09-17 20:01:19,298 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop.log.dir in system properties and HBase conf 2023-09-17 20:01:19,298 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-17 20:01:19,298 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-17 20:01:19,298 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-17 20:01:19,298 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-17 20:01:19,298 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-17 20:01:19,298 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-17 20:01:19,299 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 20:01:19,299 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-17 20:01:19,299 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-17 20:01:19,299 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-17 20:01:19,299 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-17 20:01:19,299 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-17 20:01:19,299 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-17 20:01:19,299 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/nfs.dump.dir in system properties and HBase conf 2023-09-17 20:01:19,299 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir in system properties and HBase conf 2023-09-17 20:01:19,299 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-17 20:01:19,300 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-17 20:01:19,300 INFO [Listener at localhost/34359] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-17 20:01:19,300 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694980879300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980879300"}]},"ts":"1694980879300"} 2023-09-17 20:01:19,304 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-17 20:01:19,305 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 20:01:19,306 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980879305"}]},"ts":"1694980879305"} 2023-09-17 20:01:19,308 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-17 20:01:19,313 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:01:19,314 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:01:19,314 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:01:19,314 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:01:19,314 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:01:19,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9f997e734cba795e8cbbbb5e1fe66de2, ASSIGN}] 2023-09-17 20:01:19,316 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9f997e734cba795e8cbbbb5e1fe66de2, ASSIGN 2023-09-17 20:01:19,318 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=9f997e734cba795e8cbbbb5e1fe66de2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45281,1694980876357; forceNewPlan=false, retain=false 2023-09-17 20:01:19,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-17 20:01:19,468 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-17 20:01:19,469 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9f997e734cba795e8cbbbb5e1fe66de2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:19,469 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694980879469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980879469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980879469"}]},"ts":"1694980879469"} 2023-09-17 20:01:19,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 9f997e734cba795e8cbbbb5e1fe66de2, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:01:19,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-17 20:01:19,632 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:01:19,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f997e734cba795e8cbbbb5e1fe66de2, NAME => 'hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2.', STARTKEY => '', ENDKEY => ''} 2023-09-17 20:01:19,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. service=AccessControlService 2023-09-17 20:01:19,633 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:19,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:01:19,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:19,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:01:19,634 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:01:19,636 INFO [StoreOpener-9f997e734cba795e8cbbbb5e1fe66de2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:01:19,638 DEBUG [StoreOpener-9f997e734cba795e8cbbbb5e1fe66de2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2/l 2023-09-17 20:01:19,638 DEBUG [StoreOpener-9f997e734cba795e8cbbbb5e1fe66de2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2/l 2023-09-17 20:01:19,639 INFO [StoreOpener-9f997e734cba795e8cbbbb5e1fe66de2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f997e734cba795e8cbbbb5e1fe66de2 columnFamilyName l 2023-09-17 20:01:19,640 INFO [StoreOpener-9f997e734cba795e8cbbbb5e1fe66de2-1] regionserver.HStore(310): Store=9f997e734cba795e8cbbbb5e1fe66de2/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:19,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:01:19,644 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:01:19,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:01:19,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:19,654 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f997e734cba795e8cbbbb5e1fe66de2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61583141, jitterRate=-0.08233968913555145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:01:19,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f997e734cba795e8cbbbb5e1fe66de2: 2023-09-17 20:01:19,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2., pid=11, masterSystemTime=1694980879626 2023-09-17 20:01:19,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:01:19,659 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:01:19,660 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9f997e734cba795e8cbbbb5e1fe66de2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:19,660 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694980879660"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980879660"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980879660"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980879660"}]},"ts":"1694980879660"} 2023-09-17 20:01:19,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-17 20:01:19,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 9f997e734cba795e8cbbbb5e1fe66de2, server=jenkins-hbase4.apache.org,45281,1694980876357 in 190 msec 2023-09-17 20:01:19,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-17 20:01:19,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=9f997e734cba795e8cbbbb5e1fe66de2, ASSIGN in 353 msec 2023-09-17 20:01:19,674 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 20:01:19,674 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980879674"}]},"ts":"1694980879674"} 2023-09-17 20:01:19,676 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-17 20:01:19,680 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 20:01:19,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 464 msec 2023-09-17 20:01:19,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-17 20:01:19,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-17 20:01:19,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-17 20:01:20,532 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 20:01:20,882 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 20:01:20,889 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46343_jobhistory____.8e4wiv/webapp 2023-09-17 20:01:21,058 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-17 20:01:21,058 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-17 20:01:21,058 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-17 20:01:21,062 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-17 20:01:21,146 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:21,480 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:21,738 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-17 20:01:21,770 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46343 2023-09-17 20:01:22,027 WARN [Listener at jenkins-hbase4.apache.org/36905] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 20:01:22,323 WARN [Listener at jenkins-hbase4.apache.org/36905] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-17 20:01:22,323 INFO [Listener at jenkins-hbase4.apache.org/36905] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 20:01:22,330 INFO [Listener at jenkins-hbase4.apache.org/36905] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37309_cluster____1volqk/webapp 2023-09-17 20:01:22,399 INFO [Listener at jenkins-hbase4.apache.org/36905] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-17 20:01:22,399 INFO [Listener at jenkins-hbase4.apache.org/36905] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-17 20:01:22,399 INFO [Listener at jenkins-hbase4.apache.org/36905] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-17 20:01:22,400 INFO [Listener at jenkins-hbase4.apache.org/36905] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-17 20:01:22,409 INFO [Listener at jenkins-hbase4.apache.org/36905] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:22,604 INFO [Listener at jenkins-hbase4.apache.org/36905] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:22,704 INFO [Listener at jenkins-hbase4.apache.org/36905] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:22,716 INFO [Listener at jenkins-hbase4.apache.org/36905] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37309 2023-09-17 20:01:23,151 WARN [Listener at jenkins-hbase4.apache.org/36859] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 20:01:23,177 WARN [Listener at jenkins-hbase4.apache.org/36859] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-17 20:01:23,177 INFO [Listener at jenkins-hbase4.apache.org/36859] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 20:01:23,184 INFO [Listener at jenkins-hbase4.apache.org/36859] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38059_node____.3eonlf/webapp 2023-09-17 20:01:23,237 INFO [Listener at jenkins-hbase4.apache.org/36859] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-17 20:01:23,237 INFO [Listener at jenkins-hbase4.apache.org/36859] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-17 20:01:23,237 INFO [Listener at jenkins-hbase4.apache.org/36859] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-17 20:01:23,237 INFO [Listener at jenkins-hbase4.apache.org/36859] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-17 20:01:23,248 INFO [Listener at jenkins-hbase4.apache.org/36859] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:23,308 INFO [Listener at jenkins-hbase4.apache.org/36859] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:23,378 INFO [Listener at jenkins-hbase4.apache.org/36859] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:23,388 INFO [Listener at jenkins-hbase4.apache.org/36859] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38059 2023-09-17 20:01:23,545 WARN [Listener at jenkins-hbase4.apache.org/39363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-17 20:01:23,551 WARN [Listener at jenkins-hbase4.apache.org/39363] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-17 20:01:23,551 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): jetty-6.1.26 2023-09-17 20:01:23,558 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42595_node____7xsb9t/webapp 2023-09-17 20:01:23,608 INFO [Listener at jenkins-hbase4.apache.org/39363] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-17 20:01:23,608 INFO [Listener at jenkins-hbase4.apache.org/39363] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-17 20:01:23,608 INFO [Listener at jenkins-hbase4.apache.org/39363] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-17 20:01:23,608 INFO [Listener at jenkins-hbase4.apache.org/39363] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-17 20:01:23,616 INFO [Listener at jenkins-hbase4.apache.org/39363] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:23,629 INFO [Listener at jenkins-hbase4.apache.org/39363] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:23,688 INFO [Listener at jenkins-hbase4.apache.org/39363] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-17 20:01:23,693 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42595 2023-09-17 20:01:23,718 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-17 20:01:23,719 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:01:23,788 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=126, ProcessCount=165, AvailableMemoryMB=10213 2023-09-17 20:01:23,788 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-17 20:01:23,805 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 20:01:23,806 DEBUG [Listener at jenkins-hbase4.apache.org/39363] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-17 20:01:23,813 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-17 20:01:23,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 20:01:23,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-17 20:01:23,850 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 20:01:23,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-17 20:01:23,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 20:01:23,853 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 20:01:23,859 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:23,863 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:23,865 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82 empty. 2023-09-17 20:01:23,866 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5 empty. 2023-09-17 20:01:23,866 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:23,866 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:23,867 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-17 20:01:23,905 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-17 20:01:23,907 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 68c777bfb70e3687ec36a9bf92240e82, NAME => 'testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:01:23,907 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => a50d438eac1db76a1486f527777810c5, NAME => 'testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:01:23,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 20:01:23,960 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:23,961 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing a50d438eac1db76a1486f527777810c5, disabling compactions & flushes 2023-09-17 20:01:23,961 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:23,962 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:23,962 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. after waiting 0 ms 2023-09-17 20:01:23,962 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:23,962 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:23,962 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for a50d438eac1db76a1486f527777810c5: 2023-09-17 20:01:24,026 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-17 20:01:24,028 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-17 20:01:24,029 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-17 20:01:24,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 20:01:24,364 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:24,365 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 68c777bfb70e3687ec36a9bf92240e82, disabling compactions & flushes 2023-09-17 20:01:24,365 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:24,365 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:24,365 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. after waiting 0 ms 2023-09-17 20:01:24,365 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:24,365 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:24,365 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 68c777bfb70e3687ec36a9bf92240e82: 2023-09-17 20:01:24,371 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 20:01:24,372 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980884372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980884372"}]},"ts":"1694980884372"} 2023-09-17 20:01:24,372 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980884372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980884372"}]},"ts":"1694980884372"} 2023-09-17 20:01:24,420 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 20:01:24,422 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 20:01:24,422 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980884422"}]},"ts":"1694980884422"} 2023-09-17 20:01:24,424 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-17 20:01:24,429 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:01:24,432 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:01:24,432 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:01:24,432 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:01:24,432 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:01:24,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=68c777bfb70e3687ec36a9bf92240e82, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a50d438eac1db76a1486f527777810c5, ASSIGN}] 2023-09-17 20:01:24,436 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=68c777bfb70e3687ec36a9bf92240e82, ASSIGN 2023-09-17 20:01:24,436 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a50d438eac1db76a1486f527777810c5, ASSIGN 2023-09-17 20:01:24,437 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=68c777bfb70e3687ec36a9bf92240e82, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35419,1694980876302; forceNewPlan=false, retain=false 2023-09-17 20:01:24,437 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a50d438eac1db76a1486f527777810c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45281,1694980876357; forceNewPlan=false, retain=false 2023-09-17 20:01:24,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 20:01:24,588 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 20:01:24,590 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=68c777bfb70e3687ec36a9bf92240e82, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:24,590 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a50d438eac1db76a1486f527777810c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:24,590 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980884590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980884590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980884590"}]},"ts":"1694980884590"} 2023-09-17 20:01:24,590 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980884590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980884590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980884590"}]},"ts":"1694980884590"} 2023-09-17 20:01:24,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 68c777bfb70e3687ec36a9bf92240e82, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:01:24,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure a50d438eac1db76a1486f527777810c5, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:01:24,748 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:24,748 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 20:01:24,752 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 20:01:24,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:24,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a50d438eac1db76a1486f527777810c5, NAME => 'testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 20:01:24,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. service=AccessControlService 2023-09-17 20:01:24,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:24,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:24,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:24,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:24,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:24,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:24,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 68c777bfb70e3687ec36a9bf92240e82, NAME => 'testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 20:01:24,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. service=AccessControlService 2023-09-17 20:01:24,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:24,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:24,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:24,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:24,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:24,769 INFO [StoreOpener-68c777bfb70e3687ec36a9bf92240e82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:24,769 INFO [StoreOpener-a50d438eac1db76a1486f527777810c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:24,771 DEBUG [StoreOpener-68c777bfb70e3687ec36a9bf92240e82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/cf 2023-09-17 20:01:24,771 DEBUG [StoreOpener-68c777bfb70e3687ec36a9bf92240e82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/cf 2023-09-17 20:01:24,772 DEBUG [StoreOpener-a50d438eac1db76a1486f527777810c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/cf 2023-09-17 20:01:24,772 DEBUG [StoreOpener-a50d438eac1db76a1486f527777810c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/cf 2023-09-17 20:01:24,775 INFO [StoreOpener-68c777bfb70e3687ec36a9bf92240e82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68c777bfb70e3687ec36a9bf92240e82 columnFamilyName cf 2023-09-17 20:01:24,775 INFO [StoreOpener-a50d438eac1db76a1486f527777810c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a50d438eac1db76a1486f527777810c5 columnFamilyName cf 2023-09-17 20:01:24,778 INFO [StoreOpener-68c777bfb70e3687ec36a9bf92240e82-1] regionserver.HStore(310): Store=68c777bfb70e3687ec36a9bf92240e82/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:24,778 INFO [StoreOpener-a50d438eac1db76a1486f527777810c5-1] regionserver.HStore(310): Store=a50d438eac1db76a1486f527777810c5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:24,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:24,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:24,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:24,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:24,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:24,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:24,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:24,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:24,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 68c777bfb70e3687ec36a9bf92240e82; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72864051, jitterRate=0.08575896918773651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:01:24,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 68c777bfb70e3687ec36a9bf92240e82: 2023-09-17 20:01:24,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a50d438eac1db76a1486f527777810c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68537181, jitterRate=0.021283581852912903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:01:24,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a50d438eac1db76a1486f527777810c5: 2023-09-17 20:01:24,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5., pid=16, masterSystemTime=1694980884747 2023-09-17 20:01:24,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82., pid=15, masterSystemTime=1694980884747 2023-09-17 20:01:24,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:24,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:24,806 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=68c777bfb70e3687ec36a9bf92240e82, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:24,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:24,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:24,806 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980884805"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980884805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980884805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980884805"}]},"ts":"1694980884805"} 2023-09-17 20:01:24,807 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a50d438eac1db76a1486f527777810c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:24,807 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980884807"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980884807"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980884807"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980884807"}]},"ts":"1694980884807"} 2023-09-17 20:01:24,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-17 20:01:24,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 68c777bfb70e3687ec36a9bf92240e82, server=jenkins-hbase4.apache.org,35419,1694980876302 in 216 msec 2023-09-17 20:01:24,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=68c777bfb70e3687ec36a9bf92240e82, ASSIGN in 381 msec 2023-09-17 20:01:24,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-17 20:01:24,818 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure a50d438eac1db76a1486f527777810c5, server=jenkins-hbase4.apache.org,45281,1694980876357 in 217 msec 2023-09-17 20:01:24,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-17 20:01:24,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a50d438eac1db76a1486f527777810c5, ASSIGN in 386 msec 2023-09-17 20:01:24,822 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 20:01:24,822 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980884822"}]},"ts":"1694980884822"} 2023-09-17 20:01:24,824 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-17 20:01:24,828 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 20:01:24,833 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-17 20:01:24,844 DEBUG [hconnection-0xa6d39b3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:24,847 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-17 20:01:24,856 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-17 20:01:24,894 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:24,894 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:24,894 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:24,895 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:01:24,894 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:24,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:24,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:24,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:24,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:24,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0590 sec 2023-09-17 20:01:24,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-17 20:01:24,965 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-17 20:01:24,969 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-17 20:01:24,970 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:24,973 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:01:24,995 DEBUG [hconnection-0x173cec51-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:25,001 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:25,003 DEBUG [hconnection-0x173cec51-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:25,006 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:25,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 20:01:25,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980885020 (current time:1694980885020). 2023-09-17 20:01:25,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:01:25,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x06528c7f to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:25,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48eee1c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:25,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:25,031 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:25,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06528c7f to 127.0.0.1:62829 2023-09-17 20:01:25,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:25,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x6bce12be to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:25,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a4ee43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:25,042 DEBUG [hconnection-0x5724aefa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:25,045 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:25,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:25,051 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:25,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bce12be to 127.0.0.1:62829 2023-09-17 20:01:25,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:25,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-17 20:01:25,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:01:25,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 20:01:25,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 20:01:25,099 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 20:01:25,100 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694981485100 2023-09-17 20:01:25,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 20:01:25,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-17 20:01:25,103 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 20:01:25,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 20:01:25,106 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:01:25,106 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:01:25,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-09-17 20:01:25,108 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 20:01:25,109 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694981485109 2023-09-17 20:01:25,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,135 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-17 20:01:25,135 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:25,136 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-17 20:01:25,136 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-17 20:01:25,137 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,137 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,146 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:25,146 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:25,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:25,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:25,146 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,146 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:25,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:25,147 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,147 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,148 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,148 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:01:25,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-17 20:01:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-17 20:01:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-17 20:01:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,150 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 20:01:25,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 20:01:25,152 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 20:01:25,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,156 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 20:01:25,156 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:25,156 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 20:01:25,157 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 20:01:25,156 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 20:01:25,157 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-17 20:01:25,157 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:25,157 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-17 20:01:25,157 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:25,158 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 20:01:25,159 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 20:01:25,159 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-17 20:01:25,159 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-17 20:01:25,159 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-17 20:01:25,159 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-17 20:01:25,162 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,162 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:25,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,163 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:25,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:25,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:25,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-17 20:01:25,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a0876f[Count = 1] remaining members to acquire global barrier 2023-09-17 20:01:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:25,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-17 20:01:25,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a0876f[Count = 0] remaining members to acquire global barrier 2023-09-17 20:01:25,169 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-17 20:01:25,170 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 20:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 20:01:25,172 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-17 20:01:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:01:25,173 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,173 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:01:25,173 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:25,174 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:25,174 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:25,174 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. started... 2023-09-17 20:01:25,177 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 20:01:25,177 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:25,177 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-17 20:01:25,178 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 20:01:25,178 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:25,178 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:25,178 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:25,178 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. started... 2023-09-17 20:01:25,179 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a50d438eac1db76a1486f527777810c5: 2023-09-17 20:01:25,179 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 68c777bfb70e3687ec36a9bf92240e82: 2023-09-17 20:01:25,181 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,181 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,187 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:25,187 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:25,190 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:01:25,190 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:01:25,206 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:25,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 20:01:25,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:01:25,214 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:01:25,224 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. completed. 2023-09-17 20:01:25,224 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:25,224 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:25,225 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. completed. 2023-09-17 20:01:25,225 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-17 20:01:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-17 20:01:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:01:25,225 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:01:25,227 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 20:01:25,227 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,228 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:25,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,228 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-17 20:01:25,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:25,229 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 20:01:25,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:25,229 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,229 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:25,229 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-17 20:01:25,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:25,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:25,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:01:25,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-17 20:01:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:25,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:25,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45281,1694980876357': 2023-09-17 20:01:25,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-17 20:01:25,243 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-17 20:01:25,243 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:01:25,243 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:01:25,243 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,243 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:01:25,246 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,246 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,246 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:25,246 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,247 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:25,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,246 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:25,247 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:25,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:25,247 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,248 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:25,248 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,251 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:25,251 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,251 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,264 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:01:25,265 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-17 20:01:25,265 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:01:25,265 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-17 20:01:25,266 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-17 20:01:25,266 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,266 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:25,266 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,266 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:25,266 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:25,266 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:25,266 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:25,266 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-17 20:01:25,266 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:25,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:25,266 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:25,267 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:01:25,267 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-17 20:01:25,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:25,266 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:25,267 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-17 20:01:25,267 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:25,266 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,268 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,268 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-17 20:01:25,268 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,267 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-17 20:01:25,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:25,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:01:25,268 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,268 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,268 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,268 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,268 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:25,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:25,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:25,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:25,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:25,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:25,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 20:01:25,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,344 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-17 20:01:25,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,345 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:25,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694980885101Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694980885290 (+189 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694980885290Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694980885291 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694980885306 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694980885330 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694980885344 (+14 ms) 2023-09-17 20:01:25,347 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 20:01:25,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 245 msec 2023-09-17 20:01:25,414 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:25,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 20:01:25,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:01:25,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35419] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:01:25,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:01:25,437 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-17 20:01:25,437 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:25,438 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:01:25,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 20:01:25,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980885453 (current time:1694980885453). 2023-09-17 20:01:25,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:01:25,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x5162ba59 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:25,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75956558, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:25,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:25,465 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5162ba59 to 127.0.0.1:62829 2023-09-17 20:01:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:25,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x66e4fe84 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:25,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22902073, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:25,476 DEBUG [hconnection-0x7cf13edc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:25,479 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:25,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:25,487 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:25,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66e4fe84 to 127.0.0.1:62829 2023-09-17 20:01:25,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:25,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-17 20:01:25,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:01:25,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 20:01:25,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 20:01:25,495 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 20:01:25,496 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694981485496 2023-09-17 20:01:25,496 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-17 20:01:25,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-17 20:01:25,497 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:01:25,497 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:01:25,498 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-17 20:01:25,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 20:01:25,500 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-17 20:01:25,500 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 20:01:25,501 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694981485501 2023-09-17 20:01:25,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-17 20:01:25,518 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-17 20:01:25,518 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:25,519 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-17 20:01:25,519 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-17 20:01:25,520 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,520 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,521 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:25,521 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:25,521 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:25,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:25,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:25,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:25,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:25,521 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:25,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:25,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,522 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,522 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,523 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,523 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-17 20:01:25,524 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-17 20:01:25,524 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-17 20:01:25,524 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 20:01:25,524 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-17 20:01:25,524 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:25,524 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 20:01:25,524 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-17 20:01:25,525 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:25,525 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 20:01:25,526 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 20:01:25,526 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-17 20:01:25,525 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:25,526 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-17 20:01:25,526 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-17 20:01:25,526 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-17 20:01:25,527 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-17 20:01:25,526 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-17 20:01:25,527 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-17 20:01:25,529 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,529 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,529 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:25,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:25,529 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:25,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:25,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 20:01:25,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:25,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-17 20:01:25,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58979a9b[Count = 1] remaining members to acquire global barrier 2023-09-17 20:01:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:25,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 20:01:25,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:25,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:25,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-17 20:01:25,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58979a9b[Count = 0] remaining members to acquire global barrier 2023-09-17 20:01:25,536 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-17 20:01:25,536 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 20:01:25,541 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:25,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:25,541 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 20:01:25,541 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:25,541 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:25,541 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:25,542 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. started... 2023-09-17 20:01:25,541 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:25,541 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-17 20:01:25,542 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:25,542 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:25,541 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:25,542 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. started... 2023-09-17 20:01:25,542 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 68c777bfb70e3687ec36a9bf92240e82 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-17 20:01:25,542 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-17 20:01:25,542 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:01:25,542 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:01:25,542 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a50d438eac1db76a1486f527777810c5 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-17 20:01:25,545 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 20:01:25,545 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:25,545 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-17 20:01:25,597 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:25,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 20:01:25,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:01:25,599 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:01:25,800 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:25,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 20:01:25,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:01:25,802 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-17 20:01:26,077 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917f4624357212e4f40a1ad9e40165a10b5 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917f4624357212e4f40a1ad9e40165a10b5 2023-09-17 20:01:26,077 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230917adf320978f5e48009a4c91b44c38d215 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230917adf320978f5e48009a4c91b44c38d215 2023-09-17 20:01:26,102 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:26,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 20:01:26,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:01:26,117 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-17 20:01:26,119 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/.tmp/cf/70660c8b5afa49029ec05cef0b8e5614 2023-09-17 20:01:26,119 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/.tmp/cf/9d211ae7881247268006dc34c8fb83a2 2023-09-17 20:01:26,130 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/.tmp/cf/9d211ae7881247268006dc34c8fb83a2 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/cf/9d211ae7881247268006dc34c8fb83a2 2023-09-17 20:01:26,133 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/.tmp/cf/70660c8b5afa49029ec05cef0b8e5614 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/cf/70660c8b5afa49029ec05cef0b8e5614 2023-09-17 20:01:26,139 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/cf/9d211ae7881247268006dc34c8fb83a2, entries=5, sequenceid=6, filesize=5.7 K 2023-09-17 20:01:26,142 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/cf/70660c8b5afa49029ec05cef0b8e5614, entries=45, sequenceid=6, filesize=12.5 K 2023-09-17 20:01:26,144 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 68c777bfb70e3687ec36a9bf92240e82 in 602ms, sequenceid=6, compaction requested=false 2023-09-17 20:01:26,144 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-17 20:01:26,145 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a50d438eac1db76a1486f527777810c5 in 602ms, sequenceid=6, compaction requested=false 2023-09-17 20:01:26,145 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-17 20:01:26,146 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 68c777bfb70e3687ec36a9bf92240e82: 2023-09-17 20:01:26,146 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a50d438eac1db76a1486f527777810c5: 2023-09-17 20:01:26,147 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-17 20:01:26,147 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-17 20:01:26,147 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:26,147 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:26,147 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/cf/70660c8b5afa49029ec05cef0b8e5614] hfiles 2023-09-17 20:01:26,147 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/cf/9d211ae7881247268006dc34c8fb83a2] hfiles 2023-09-17 20:01:26,147 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/cf/70660c8b5afa49029ec05cef0b8e5614 for snapshot=snaptb0-testExportWithTargetName 2023-09-17 20:01:26,147 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/cf/9d211ae7881247268006dc34c8fb83a2 for snapshot=snaptb0-testExportWithTargetName 2023-09-17 20:01:26,171 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. completed. 2023-09-17 20:01:26,171 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:26,171 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-17 20:01:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:01:26,172 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. completed. 2023-09-17 20:01:26,173 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-17 20:01:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:01:26,174 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,174 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 20:01:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:26,174 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:26,174 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-17 20:01:26,176 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:26,177 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-17 20:01:26,177 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:26,177 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-17 20:01:26,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:26,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 20:01:26,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:26,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 20:01:26,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45281,1694980876357': 2023-09-17 20:01:26,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-17 20:01:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:26,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:26,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 20:01:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:26,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 20:01:26,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:01:26,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-17 20:01:26,188 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-17 20:01:26,188 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:01:26,188 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:01:26,188 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-17 20:01:26,188 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:01:26,191 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,191 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,191 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,191 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:26,191 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:26,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,191 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:26,191 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:26,192 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:26,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:26,192 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 20:01:26,197 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:26,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 20:01:26,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,200 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:26,200 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-17 20:01:26,200 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,211 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,211 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:26,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:26,211 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:26,211 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-17 20:01:26,211 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:26,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-17 20:01:26,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:26,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:26,211 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:26,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-17 20:01:26,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:26,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:26,212 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:26,212 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,212 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:26,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:26,212 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,213 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,213 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:26,213 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,213 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:26,213 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:26,213 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,213 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:01:26,212 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:26,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:26,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:26,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:26,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:26,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:26,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230917adf320978f5e48009a4c91b44c38d215, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917f4624357212e4f40a1ad9e40165a10b5] mob files 2023-09-17 20:01:26,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230917adf320978f5e48009a4c91b44c38d215 2023-09-17 20:01:26,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917f4624357212e4f40a1ad9e40165a10b5 2023-09-17 20:01:26,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-17 20:01:26,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-17 20:01:26,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,277 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-17 20:01:26,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694980885496Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694980886234 (+738 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694980886234Loading Region manifests for snaptb0-testExportWithTargetName at 1694980886235 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1694980886241 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694980886264 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694980886277 (+13 ms) 2023-09-17 20:01:26,280 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-17 20:01:26,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 784 msec 2023-09-17 20:01:26,617 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:26,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-17 20:01:26,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:01:26,621 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621 2023-09-17 20:01:26,621 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36291, tgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621, rawTgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621, srcFsUri=hdfs://localhost:36291, srcDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:26,663 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:26,664 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1583390634_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-17 20:01:26,664 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c, snapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-17 20:01:26,683 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-17 20:01:26,756 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:26,757 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:26,757 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:26,757 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:27,672 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-2388311589591566606.jar 2023-09-17 20:01:27,673 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:27,673 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:27,743 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-900963043381647238.jar 2023-09-17 20:01:27,743 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:27,744 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:27,744 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:27,745 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:27,745 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:27,746 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:27,747 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 20:01:27,747 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 20:01:27,748 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 20:01:27,749 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 20:01:27,750 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 20:01:27,751 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 20:01:27,751 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 20:01:27,751 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 20:01:27,752 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 20:01:27,752 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 20:01:27,756 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:01:27,757 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:01:27,757 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:01:27,757 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:01:27,758 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:01:27,758 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:01:27,759 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:01:29,013 WARN [Listener at jenkins-hbase4.apache.org/39363] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 20:01:29,018 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-17 20:01:29,026 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-17 20:01:29,489 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:01:29,491 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:01:29,881 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0001_000001 (auth:SIMPLE) 2023-09-17 20:01:30,270 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 20:01:34,152 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0001_000001 (auth:SIMPLE) 2023-09-17 20:01:36,397 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0001_000001 (auth:SIMPLE) 2023-09-17 20:01:39,638 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0001_000001 (auth:SIMPLE) 2023-09-17 20:01:40,864 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 20:01:40,867 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 20:01:40,878 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-17 20:01:40,878 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 20:01:40,879 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 20:01:40,879 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-17 20:01:40,879 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-17 20:01:40,879 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-17 20:01:40,879 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621/.hbase-snapshot/testExportWithTargetName 2023-09-17 20:01:40,880 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-17 20:01:40,880 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980886621/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-17 20:01:40,890 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-17 20:01:40,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-17 20:01:40,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-17 20:01:40,907 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980900907"}]},"ts":"1694980900907"} 2023-09-17 20:01:40,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-17 20:01:40,909 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-17 20:01:40,911 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-17 20:01:40,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=68c777bfb70e3687ec36a9bf92240e82, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a50d438eac1db76a1486f527777810c5, UNASSIGN}] 2023-09-17 20:01:40,915 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=68c777bfb70e3687ec36a9bf92240e82, UNASSIGN 2023-09-17 20:01:40,915 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a50d438eac1db76a1486f527777810c5, UNASSIGN 2023-09-17 20:01:40,916 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=68c777bfb70e3687ec36a9bf92240e82, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:40,916 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a50d438eac1db76a1486f527777810c5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:40,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980900916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980900916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980900916"}]},"ts":"1694980900916"} 2023-09-17 20:01:40,916 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980900916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980900916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980900916"}]},"ts":"1694980900916"} 2023-09-17 20:01:40,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 68c777bfb70e3687ec36a9bf92240e82, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:01:40,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure a50d438eac1db76a1486f527777810c5, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:01:41,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-17 20:01:41,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:41,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:41,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a50d438eac1db76a1486f527777810c5, disabling compactions & flushes 2023-09-17 20:01:41,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 68c777bfb70e3687ec36a9bf92240e82, disabling compactions & flushes 2023-09-17 20:01:41,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:41,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:41,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:41,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:41,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. after waiting 0 ms 2023-09-17 20:01:41,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:41,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. after waiting 0 ms 2023-09-17 20:01:41,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:41,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:01:41,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:01:41,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:01:41,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:01:41,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5. 2023-09-17 20:01:41,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82. 2023-09-17 20:01:41,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 68c777bfb70e3687ec36a9bf92240e82: 2023-09-17 20:01:41,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a50d438eac1db76a1486f527777810c5: 2023-09-17 20:01:41,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:41,100 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a50d438eac1db76a1486f527777810c5, regionState=CLOSED 2023-09-17 20:01:41,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:41,100 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980901100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980901100"}]},"ts":"1694980901100"} 2023-09-17 20:01:41,101 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=68c777bfb70e3687ec36a9bf92240e82, regionState=CLOSED 2023-09-17 20:01:41,101 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694980901100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980901100"}]},"ts":"1694980901100"} 2023-09-17 20:01:41,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-17 20:01:41,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure a50d438eac1db76a1486f527777810c5, server=jenkins-hbase4.apache.org,45281,1694980876357 in 183 msec 2023-09-17 20:01:41,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-17 20:01:41,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 68c777bfb70e3687ec36a9bf92240e82, server=jenkins-hbase4.apache.org,35419,1694980876302 in 185 msec 2023-09-17 20:01:41,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a50d438eac1db76a1486f527777810c5, UNASSIGN in 191 msec 2023-09-17 20:01:41,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-17 20:01:41,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=68c777bfb70e3687ec36a9bf92240e82, UNASSIGN in 192 msec 2023-09-17 20:01:41,108 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980901108"}]},"ts":"1694980901108"} 2023-09-17 20:01:41,110 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-17 20:01:41,111 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-17 20:01:41,114 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 215 msec 2023-09-17 20:01:41,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-17 20:01:41,211 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-17 20:01:41,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-17 20:01:41,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 20:01:41,225 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 20:01:41,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-17 20:01:41,227 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 20:01:41,230 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-17 20:01:41,233 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:41,233 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:41,234 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 20:01:41,234 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 20:01:41,234 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 20:01:41,234 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 20:01:41,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-17 20:01:41,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-17 20:01:41,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-17 20:01:41,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-17 20:01:41,238 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/recovered.edits] 2023-09-17 20:01:41,238 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/recovered.edits] 2023-09-17 20:01:41,241 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 20:01:41,241 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 20:01:41,241 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 20:01:41,241 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:41,241 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:41,241 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:41,242 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-17 20:01:41,242 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:41,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-17 20:01:41,247 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/cf/9d211ae7881247268006dc34c8fb83a2 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/cf/9d211ae7881247268006dc34c8fb83a2 2023-09-17 20:01:41,248 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/cf/70660c8b5afa49029ec05cef0b8e5614 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/cf/70660c8b5afa49029ec05cef0b8e5614 2023-09-17 20:01:41,252 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5/recovered.edits/9.seqid 2023-09-17 20:01:41,252 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82/recovered.edits/9.seqid 2023-09-17 20:01:41,253 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/a50d438eac1db76a1486f527777810c5 2023-09-17 20:01:41,253 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportWithTargetName/68c777bfb70e3687ec36a9bf92240e82 2023-09-17 20:01:41,253 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-17 20:01:41,253 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-17 20:01:41,254 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-17 20:01:41,258 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230917adf320978f5e48009a4c91b44c38d215 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230917adf320978f5e48009a4c91b44c38d215 2023-09-17 20:01:41,259 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917f4624357212e4f40a1ad9e40165a10b5 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230917f4624357212e4f40a1ad9e40165a10b5 2023-09-17 20:01:41,260 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-17 20:01:41,263 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 20:01:41,284 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-17 20:01:41,286 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-17 20:01:41,288 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 20:01:41,288 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-17 20:01:41,288 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980901288"}]},"ts":"9223372036854775807"} 2023-09-17 20:01:41,288 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980901288"}]},"ts":"9223372036854775807"} 2023-09-17 20:01:41,291 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 20:01:41,291 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 68c777bfb70e3687ec36a9bf92240e82, NAME => 'testtb-testExportWithTargetName,,1694980883840.68c777bfb70e3687ec36a9bf92240e82.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a50d438eac1db76a1486f527777810c5, NAME => 'testtb-testExportWithTargetName,1,1694980883840.a50d438eac1db76a1486f527777810c5.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 20:01:41,291 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-17 20:01:41,291 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694980901291"}]},"ts":"9223372036854775807"} 2023-09-17 20:01:41,293 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-17 20:01:41,295 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-17 20:01:41,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 78 msec 2023-09-17 20:01:41,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-17 20:01:41,350 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-17 20:01:41,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-17 20:01:41,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-17 20:01:41,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-17 20:01:41,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-17 20:01:41,408 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=759 (was 706) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1811510080_1 at /127.0.0.1:41476 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:34161 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:41504 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1811510080_1 at /127.0.0.1:43318 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:43328 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:51152 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:39363 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:36859 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:39903 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 126) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=9348 (was 10213) 2023-09-17 20:01:41,408 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-17 20:01:41,427 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=759, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=168, AvailableMemoryMB=9347 2023-09-17 20:01:41,427 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-17 20:01:41,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 20:01:41,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-17 20:01:41,434 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 20:01:41,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-17 20:01:41,437 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 20:01:41,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-17 20:01:41,441 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:41,441 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:41,442 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a empty. 2023-09-17 20:01:41,442 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78 empty. 2023-09-17 20:01:41,442 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:41,442 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:41,442 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-17 20:01:41,458 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-17 20:01:41,459 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9e611804ce07127beea97051dc83b40a, NAME => 'testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:01:41,459 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => bd7657e5ebb0469647d3649731d6fd78, NAME => 'testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:01:41,490 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:41,491 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9e611804ce07127beea97051dc83b40a, disabling compactions & flushes 2023-09-17 20:01:41,491 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:41,491 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:41,492 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. after waiting 0 ms 2023-09-17 20:01:41,492 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:41,492 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:41,492 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9e611804ce07127beea97051dc83b40a: 2023-09-17 20:01:41,492 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:41,492 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing bd7657e5ebb0469647d3649731d6fd78, disabling compactions & flushes 2023-09-17 20:01:41,492 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:41,493 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:41,493 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. after waiting 0 ms 2023-09-17 20:01:41,493 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:41,493 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:41,493 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for bd7657e5ebb0469647d3649731d6fd78: 2023-09-17 20:01:41,496 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 20:01:41,497 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980901496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980901496"}]},"ts":"1694980901496"} 2023-09-17 20:01:41,497 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980901496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980901496"}]},"ts":"1694980901496"} 2023-09-17 20:01:41,499 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 20:01:41,500 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 20:01:41,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980901500"}]},"ts":"1694980901500"} 2023-09-17 20:01:41,502 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-17 20:01:41,506 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:01:41,507 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:01:41,507 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:01:41,508 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:01:41,508 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:01:41,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e611804ce07127beea97051dc83b40a, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd7657e5ebb0469647d3649731d6fd78, ASSIGN}] 2023-09-17 20:01:41,511 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e611804ce07127beea97051dc83b40a, ASSIGN 2023-09-17 20:01:41,511 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd7657e5ebb0469647d3649731d6fd78, ASSIGN 2023-09-17 20:01:41,512 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e611804ce07127beea97051dc83b40a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41855,1694980876397; forceNewPlan=false, retain=false 2023-09-17 20:01:41,512 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd7657e5ebb0469647d3649731d6fd78, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45281,1694980876357; forceNewPlan=false, retain=false 2023-09-17 20:01:41,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-17 20:01:41,662 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 20:01:41,665 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9e611804ce07127beea97051dc83b40a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:41,665 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=bd7657e5ebb0469647d3649731d6fd78, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:41,665 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980901665"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980901665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980901665"}]},"ts":"1694980901665"} 2023-09-17 20:01:41,665 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980901665"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980901665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980901665"}]},"ts":"1694980901665"} 2023-09-17 20:01:41,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 9e611804ce07127beea97051dc83b40a, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:01:41,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure bd7657e5ebb0469647d3649731d6fd78, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:01:41,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-17 20:01:41,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:41,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bd7657e5ebb0469647d3649731d6fd78, NAME => 'testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 20:01:41,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:41,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e611804ce07127beea97051dc83b40a, NAME => 'testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 20:01:41,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. service=AccessControlService 2023-09-17 20:01:41,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:41,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:41,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:41,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:41,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:41,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. service=AccessControlService 2023-09-17 20:01:41,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:41,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:41,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:41,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:41,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:41,832 INFO [StoreOpener-bd7657e5ebb0469647d3649731d6fd78-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:41,833 INFO [StoreOpener-9e611804ce07127beea97051dc83b40a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:41,833 DEBUG [StoreOpener-bd7657e5ebb0469647d3649731d6fd78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/cf 2023-09-17 20:01:41,834 DEBUG [StoreOpener-bd7657e5ebb0469647d3649731d6fd78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/cf 2023-09-17 20:01:41,834 INFO [StoreOpener-bd7657e5ebb0469647d3649731d6fd78-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd7657e5ebb0469647d3649731d6fd78 columnFamilyName cf 2023-09-17 20:01:41,834 DEBUG [StoreOpener-9e611804ce07127beea97051dc83b40a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/cf 2023-09-17 20:01:41,834 DEBUG [StoreOpener-9e611804ce07127beea97051dc83b40a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/cf 2023-09-17 20:01:41,835 INFO [StoreOpener-9e611804ce07127beea97051dc83b40a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e611804ce07127beea97051dc83b40a columnFamilyName cf 2023-09-17 20:01:41,836 INFO [StoreOpener-bd7657e5ebb0469647d3649731d6fd78-1] regionserver.HStore(310): Store=bd7657e5ebb0469647d3649731d6fd78/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:41,838 INFO [StoreOpener-9e611804ce07127beea97051dc83b40a-1] regionserver.HStore(310): Store=9e611804ce07127beea97051dc83b40a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:41,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:41,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:41,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:41,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:41,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:41,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:41,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:41,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:41,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bd7657e5ebb0469647d3649731d6fd78; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61967769, jitterRate=-0.07660828530788422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:01:41,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bd7657e5ebb0469647d3649731d6fd78: 2023-09-17 20:01:41,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9e611804ce07127beea97051dc83b40a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69479200, jitterRate=0.03532075881958008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:01:41,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9e611804ce07127beea97051dc83b40a: 2023-09-17 20:01:41,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78., pid=31, masterSystemTime=1694980901824 2023-09-17 20:01:41,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a., pid=30, masterSystemTime=1694980901821 2023-09-17 20:01:41,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:41,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:41,850 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=bd7657e5ebb0469647d3649731d6fd78, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:41,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:41,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:41,850 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980901850"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980901850"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980901850"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980901850"}]},"ts":"1694980901850"} 2023-09-17 20:01:41,851 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9e611804ce07127beea97051dc83b40a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:41,851 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980901851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980901851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980901851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980901851"}]},"ts":"1694980901851"} 2023-09-17 20:01:41,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-17 20:01:41,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure bd7657e5ebb0469647d3649731d6fd78, server=jenkins-hbase4.apache.org,45281,1694980876357 in 183 msec 2023-09-17 20:01:41,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-17 20:01:41,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 9e611804ce07127beea97051dc83b40a, server=jenkins-hbase4.apache.org,41855,1694980876397 in 186 msec 2023-09-17 20:01:41,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd7657e5ebb0469647d3649731d6fd78, ASSIGN in 350 msec 2023-09-17 20:01:41,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-17 20:01:41,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e611804ce07127beea97051dc83b40a, ASSIGN in 352 msec 2023-09-17 20:01:41,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 20:01:41,863 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980901863"}]},"ts":"1694980901863"} 2023-09-17 20:01:41,865 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-17 20:01:41,868 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 20:01:41,868 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-17 20:01:41,870 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 20:01:41,871 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:41,871 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:41,871 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:41,871 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:41,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:41,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:41,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:41,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:41,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 443 msec 2023-09-17 20:01:42,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-17 20:01:42,042 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-17 20:01:42,044 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-17 20:01:42,044 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:42,047 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:01:42,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:01:42,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980902066 (current time:1694980902066). 2023-09-17 20:01:42,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:01:42,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x201341d8 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:42,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d70e1fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:42,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:42,079 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:42,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x201341d8 to 127.0.0.1:62829 2023-09-17 20:01:42,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:42,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x0c18c255 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:42,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36bf5f8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:42,088 DEBUG [hconnection-0x6c9a3fac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:42,089 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:42,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:42,094 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:42,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c18c255 to 127.0.0.1:62829 2023-09-17 20:01:42,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:42,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 20:01:42,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:01:42,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:01:42,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:01:42,100 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:01:42,101 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694981502101 2023-09-17 20:01:42,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:01:42,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-17 20:01:42,103 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:01:42,103 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:01:42,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 20:01:42,104 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:01:42,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-17 20:01:42,107 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 20:01:42,108 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694981502108 2023-09-17 20:01:42,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,121 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-17 20:01:42,121 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:42,123 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-17 20:01:42,123 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-17 20:01:42,124 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,124 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,125 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,125 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,125 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,125 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,126 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,126 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,126 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,126 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:01:42,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 20:01:42,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 20:01:42,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,133 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 20:01:42,133 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 20:01:42,133 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:42,133 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:42,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 20:01:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-17 20:01:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 20:01:42,134 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 20:01:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-17 20:01:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-17 20:01:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:42,135 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-17 20:01:42,136 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 20:01:42,136 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-17 20:01:42,136 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-17 20:01:42,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,144 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,144 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,144 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,144 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,144 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:42,144 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,144 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:42,144 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,145 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-17 20:01:42,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70c27d20[Count = 1] remaining members to acquire global barrier 2023-09-17 20:01:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-17 20:01:42,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70c27d20[Count = 0] remaining members to acquire global barrier 2023-09-17 20:01:42,148 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-17 20:01:42,148 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:01:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,150 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:01:42,150 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:01:42,150 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:42,150 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:42,150 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:42,150 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. started... 2023-09-17 20:01:42,150 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,151 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:01:42,151 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:42,151 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:42,151 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e611804ce07127beea97051dc83b40a: 2023-09-17 20:01:42,150 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:42,150 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-17 20:01:42,151 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. started... 2023-09-17 20:01:42,151 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:01:42,151 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,151 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:42,152 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bd7657e5ebb0469647d3649731d6fd78: 2023-09-17 20:01:42,152 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:01:42,152 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,152 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:42,152 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:01:42,153 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 20:01:42,153 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:42,153 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-17 20:01:42,177 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. completed. 2023-09-17 20:01:42,177 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:42,177 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. completed. 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,178 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-17 20:01:42,178 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:01:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 20:01:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 20:01:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:42,180 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-17 20:01:42,181 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,180 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:42,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,181 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-17 20:01:42,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:01:42,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-17 20:01:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45281,1694980876357': 2023-09-17 20:01:42,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-17 20:01:42,190 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-17 20:01:42,190 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:01:42,190 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:01:42,190 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,190 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:01:42,203 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:42,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 20:01:42,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:01:42,204 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:01:42,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,223 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,223 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,223 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,223 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,224 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,225 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,227 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,227 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,227 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,253 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,253 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,254 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,254 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:42,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,254 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-17 20:01:42,256 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,253 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,256 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:01:42,256 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,256 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,254 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,254 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,256 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,256 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,257 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,257 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,257 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 20:01:42,257 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,290 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-17 20:01:42,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,291 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:42,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694980902101Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694980902268 (+167 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694980902268Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694980902268Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694980902272 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694980902281 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694980902290 (+9 ms) 2023-09-17 20:01:42,294 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 20:01:42,296 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 192 msec 2023-09-17 20:01:42,372 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-17 20:01:42,404 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:42,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 20:01:42,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:01:42,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41855] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:01:42,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:01:42,416 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-17 20:01:42,416 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:42,416 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:01:42,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:01:42,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980902428 (current time:1694980902428). 2023-09-17 20:01:42,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:01:42,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x0d7176a0 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:42,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19ada20a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:42,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:42,439 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:42,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d7176a0 to 127.0.0.1:62829 2023-09-17 20:01:42,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:42,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x2eccf481 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:42,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cc71967, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:42,449 DEBUG [hconnection-0x635aed84-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:42,452 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:42,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:42,458 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:42,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2eccf481 to 127.0.0.1:62829 2023-09-17 20:01:42,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:42,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 20:01:42,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:01:42,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:01:42,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:01:42,463 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:01:42,464 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694981502464 2023-09-17 20:01:42,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-17 20:01:42,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:01:42,466 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:01:42,466 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:01:42,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 20:01:42,467 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:01:42,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-17 20:01:42,470 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 20:01:42,471 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694981502471 2023-09-17 20:01:42,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-17 20:01:42,485 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-17 20:01:42,485 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:42,486 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-17 20:01:42,487 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-17 20:01:42,487 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,487 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,488 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,488 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,489 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,488 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,489 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,489 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,490 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,490 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 20:01:42,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-17 20:01:42,491 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 20:01:42,491 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-17 20:01:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-17 20:01:42,491 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 20:01:42,491 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:42,491 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:42,492 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 20:01:42,493 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-17 20:01:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,493 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-17 20:01:42,493 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 20:01:42,493 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-17 20:01:42,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-17 20:01:42,493 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-17 20:01:42,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-17 20:01:42,494 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-17 20:01:42,494 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:42,495 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-17 20:01:42,495 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-17 20:01:42,495 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-17 20:01:42,496 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,497 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,497 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,497 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,497 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:42,497 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,497 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:42,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 20:01:42,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-17 20:01:42,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@745d17a8[Count = 1] remaining members to acquire global barrier 2023-09-17 20:01:42,503 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,503 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,503 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,503 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 20:01:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-17 20:01:42,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@745d17a8[Count = 0] remaining members to acquire global barrier 2023-09-17 20:01:42,506 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-17 20:01:42,506 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:01:42,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,507 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:01:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:42,507 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:01:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:42,508 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:42,508 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-17 20:01:42,508 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,508 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. started... 2023-09-17 20:01:42,508 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. started... 2023-09-17 20:01:42,508 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:01:42,508 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:01:42,508 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9e611804ce07127beea97051dc83b40a 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-17 20:01:42,508 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bd7657e5ebb0469647d3649731d6fd78 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-17 20:01:42,510 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 20:01:42,510 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:42,510 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-17 20:01:42,548 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309175ac15b52d2944498b2eac0e8bfe717d0 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309175ac15b52d2944498b2eac0e8bfe717d0 2023-09-17 20:01:42,557 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917b506cd80dd294d46bd3697028c852613 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917b506cd80dd294d46bd3697028c852613 2023-09-17 20:01:42,566 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:42,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 20:01:42,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:01:42,568 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:01:42,569 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/.tmp/cf/32e27c95fb814b188eed0c9045738db2 2023-09-17 20:01:42,577 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/.tmp/cf/8934f23374ed4f5ab44211f2876659dc 2023-09-17 20:01:42,579 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/.tmp/cf/32e27c95fb814b188eed0c9045738db2 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/cf/32e27c95fb814b188eed0c9045738db2 2023-09-17 20:01:42,584 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/.tmp/cf/8934f23374ed4f5ab44211f2876659dc as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/cf/8934f23374ed4f5ab44211f2876659dc 2023-09-17 20:01:42,588 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/cf/32e27c95fb814b188eed0c9045738db2, entries=45, sequenceid=6, filesize=12.5 K 2023-09-17 20:01:42,590 INFO [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for bd7657e5ebb0469647d3649731d6fd78 in 82ms, sequenceid=6, compaction requested=false 2023-09-17 20:01:42,592 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bd7657e5ebb0469647d3649731d6fd78: 2023-09-17 20:01:42,592 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-17 20:01:42,592 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:42,592 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/cf/32e27c95fb814b188eed0c9045738db2] hfiles 2023-09-17 20:01:42,592 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/cf/32e27c95fb814b188eed0c9045738db2 for snapshot=snaptb0-testExportFileSystemState 2023-09-17 20:01:42,593 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/cf/8934f23374ed4f5ab44211f2876659dc, entries=5, sequenceid=6, filesize=5.7 K 2023-09-17 20:01:42,594 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 9e611804ce07127beea97051dc83b40a in 86ms, sequenceid=6, compaction requested=false 2023-09-17 20:01:42,594 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e611804ce07127beea97051dc83b40a: 2023-09-17 20:01:42,594 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-17 20:01:42,594 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:42,594 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/cf/8934f23374ed4f5ab44211f2876659dc] hfiles 2023-09-17 20:01:42,594 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/cf/8934f23374ed4f5ab44211f2876659dc for snapshot=snaptb0-testExportFileSystemState 2023-09-17 20:01:42,617 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. completed. 2023-09-17 20:01:42,617 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-17 20:01:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:01:42,624 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 20:01:42,624 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,624 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:42,624 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-17 20:01:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 20:01:42,627 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. completed. 2023-09-17 20:01:42,627 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:42,627 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:42,627 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:42,627 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,628 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-17 20:01:42,628 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:01:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,630 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-17 20:01:42,630 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,631 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,630 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-17 20:01:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 20:01:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45281,1694980876357': 2023-09-17 20:01:42,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-17 20:01:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 20:01:42,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 20:01:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:01:42,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-17 20:01:42,637 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-17 20:01:42,638 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:01:42,638 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:01:42,638 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-17 20:01:42,638 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:01:42,639 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,639 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,640 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,639 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,639 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,640 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,640 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,641 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,641 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 20:01:42,642 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 20:01:42,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,646 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,646 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:42,647 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-17 20:01:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,652 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:42,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,652 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-17 20:01:42,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:42,652 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:42,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:01:42,652 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:42,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:42,655 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:42,656 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:42,656 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,656 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:42,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309175ac15b52d2944498b2eac0e8bfe717d0, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917b506cd80dd294d46bd3697028c852613] mob files 2023-09-17 20:01:42,656 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:42,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309175ac15b52d2944498b2eac0e8bfe717d0 2023-09-17 20:01:42,656 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917b506cd80dd294d46bd3697028c852613 2023-09-17 20:01:42,656 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-17 20:01:42,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-17 20:01:42,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,703 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694980902465Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694980902668 (+203 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694980902668Loading Region manifests for snaptb0-testExportFileSystemState at 1694980902668Writing data manifest for snaptb0-testExportFileSystemState at 1694980902673 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694980902689 (+16 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694980902703 (+14 ms) 2023-09-17 20:01:42,706 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-17 20:01:42,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 242 msec 2023-09-17 20:01:42,768 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:42,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 20:01:42,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:01:42,770 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770 2023-09-17 20:01:42,770 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36291, tgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770, rawTgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770, srcFsUri=hdfs://localhost:36291, srcDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:42,793 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:42,793 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1062206728_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,793 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c, snapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-17 20:01:42,808 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-17 20:01:42,839 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:42,840 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:42,840 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:42,841 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:43,750 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-5738395904905338431.jar 2023-09-17 20:01:43,751 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:43,751 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:43,823 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-2283957717833560428.jar 2023-09-17 20:01:43,824 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:43,824 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:43,825 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:43,825 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:43,826 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:43,826 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:43,826 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 20:01:43,827 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 20:01:43,827 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 20:01:43,827 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 20:01:43,828 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 20:01:43,828 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 20:01:43,829 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 20:01:43,829 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 20:01:43,830 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 20:01:43,831 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 20:01:43,831 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:01:43,832 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:01:43,832 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:01:43,833 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:01:43,833 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:01:43,834 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:01:43,834 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:01:44,261 WARN [Listener at jenkins-hbase4.apache.org/39363] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 20:01:44,264 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-17 20:01:44,266 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-17 20:01:45,834 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:01:45,834 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:01:45,841 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0001_000001 (auth:SIMPLE) 2023-09-17 20:01:46,651 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0002_000001 (auth:SIMPLE) 2023-09-17 20:01:46,699 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 20:01:50,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0002_000001 (auth:SIMPLE) 2023-09-17 20:01:52,939 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0002_000001 (auth:SIMPLE) 2023-09-17 20:01:56,057 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0002_000001 (auth:SIMPLE) 2023-09-17 20:01:57,462 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 20:01:57,463 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 20:01:57,471 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-17 20:01:57,471 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 20:01:57,472 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 20:01:57,472 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-17 20:01:57,473 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-17 20:01:57,473 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-17 20:01:57,473 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-17 20:01:57,473 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-17 20:01:57,473 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980902770/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-17 20:01:57,481 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-17 20:01:57,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-17 20:01:57,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-17 20:01:57,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-17 20:01:57,487 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980917487"}]},"ts":"1694980917487"} 2023-09-17 20:01:57,489 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-17 20:01:57,491 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-17 20:01:57,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e611804ce07127beea97051dc83b40a, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd7657e5ebb0469647d3649731d6fd78, UNASSIGN}] 2023-09-17 20:01:57,494 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e611804ce07127beea97051dc83b40a, UNASSIGN 2023-09-17 20:01:57,494 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd7657e5ebb0469647d3649731d6fd78, UNASSIGN 2023-09-17 20:01:57,495 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9e611804ce07127beea97051dc83b40a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:57,495 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bd7657e5ebb0469647d3649731d6fd78, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:57,495 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980917495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980917495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980917495"}]},"ts":"1694980917495"} 2023-09-17 20:01:57,495 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980917495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980917495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980917495"}]},"ts":"1694980917495"} 2023-09-17 20:01:57,497 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9e611804ce07127beea97051dc83b40a, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:01:57,498 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure bd7657e5ebb0469647d3649731d6fd78, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:01:57,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-17 20:01:57,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:57,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9e611804ce07127beea97051dc83b40a, disabling compactions & flushes 2023-09-17 20:01:57,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:57,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:57,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. after waiting 0 ms 2023-09-17 20:01:57,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:57,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:57,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bd7657e5ebb0469647d3649731d6fd78, disabling compactions & flushes 2023-09-17 20:01:57,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:57,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:57,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. after waiting 0 ms 2023-09-17 20:01:57,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:57,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:01:57,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:01:57,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:01:57,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78. 2023-09-17 20:01:57,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:01:57,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bd7657e5ebb0469647d3649731d6fd78: 2023-09-17 20:01:57,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a. 2023-09-17 20:01:57,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9e611804ce07127beea97051dc83b40a: 2023-09-17 20:01:57,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:57,666 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bd7657e5ebb0469647d3649731d6fd78, regionState=CLOSED 2023-09-17 20:01:57,666 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980917666"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980917666"}]},"ts":"1694980917666"} 2023-09-17 20:01:57,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:57,667 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9e611804ce07127beea97051dc83b40a, regionState=CLOSED 2023-09-17 20:01:57,667 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694980917667"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980917667"}]},"ts":"1694980917667"} 2023-09-17 20:01:57,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-17 20:01:57,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure bd7657e5ebb0469647d3649731d6fd78, server=jenkins-hbase4.apache.org,45281,1694980876357 in 170 msec 2023-09-17 20:01:57,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-17 20:01:57,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9e611804ce07127beea97051dc83b40a, server=jenkins-hbase4.apache.org,41855,1694980876397 in 172 msec 2023-09-17 20:01:57,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bd7657e5ebb0469647d3649731d6fd78, UNASSIGN in 180 msec 2023-09-17 20:01:57,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-17 20:01:57,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9e611804ce07127beea97051dc83b40a, UNASSIGN in 181 msec 2023-09-17 20:01:57,675 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980917675"}]},"ts":"1694980917675"} 2023-09-17 20:01:57,676 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-17 20:01:57,678 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-17 20:01:57,680 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-09-17 20:01:57,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-17 20:01:57,789 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-17 20:01:57,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-17 20:01:57,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 20:01:57,794 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 20:01:57,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-17 20:01:57,795 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 20:01:57,796 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-17 20:01:57,800 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:57,800 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:57,800 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 20:01:57,800 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 20:01:57,800 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 20:01:57,800 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 20:01:57,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-17 20:01:57,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-17 20:01:57,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-17 20:01:57,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-17 20:01:57,802 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 20:01:57,802 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 20:01:57,802 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:57,802 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 20:01:57,802 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:57,802 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-17 20:01:57,802 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:57,802 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:57,803 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/recovered.edits] 2023-09-17 20:01:57,803 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/recovered.edits] 2023-09-17 20:01:57,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-17 20:01:57,807 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/cf/8934f23374ed4f5ab44211f2876659dc to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/cf/8934f23374ed4f5ab44211f2876659dc 2023-09-17 20:01:57,808 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/cf/32e27c95fb814b188eed0c9045738db2 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/cf/32e27c95fb814b188eed0c9045738db2 2023-09-17 20:01:57,811 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a/recovered.edits/9.seqid 2023-09-17 20:01:57,812 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78/recovered.edits/9.seqid 2023-09-17 20:01:57,812 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/9e611804ce07127beea97051dc83b40a 2023-09-17 20:01:57,812 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemState/bd7657e5ebb0469647d3649731d6fd78 2023-09-17 20:01:57,812 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-17 20:01:57,813 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-17 20:01:57,813 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-17 20:01:57,817 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309175ac15b52d2944498b2eac0e8bfe717d0 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309175ac15b52d2944498b2eac0e8bfe717d0 2023-09-17 20:01:57,819 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917b506cd80dd294d46bd3697028c852613 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230917b506cd80dd294d46bd3697028c852613 2023-09-17 20:01:57,819 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-17 20:01:57,822 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 20:01:57,824 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-17 20:01:57,826 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-17 20:01:57,827 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 20:01:57,827 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-17 20:01:57,827 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980917827"}]},"ts":"9223372036854775807"} 2023-09-17 20:01:57,828 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980917827"}]},"ts":"9223372036854775807"} 2023-09-17 20:01:57,829 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 20:01:57,830 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9e611804ce07127beea97051dc83b40a, NAME => 'testtb-testExportFileSystemState,,1694980901429.9e611804ce07127beea97051dc83b40a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bd7657e5ebb0469647d3649731d6fd78, NAME => 'testtb-testExportFileSystemState,1,1694980901429.bd7657e5ebb0469647d3649731d6fd78.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 20:01:57,830 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-17 20:01:57,830 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694980917830"}]},"ts":"9223372036854775807"} 2023-09-17 20:01:57,831 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-17 20:01:57,833 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-17 20:01:57,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-09-17 20:01:57,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-17 20:01:57,905 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-17 20:01:57,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-17 20:01:57,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-17 20:01:57,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-17 20:01:57,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-17 20:01:57,944 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=769 (was 759) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2081 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1597400086_1 at /127.0.0.1:54336 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1597400086_1 at /127.0.0.1:56412 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:44987 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:54316 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:54370 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:56432 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=939 (was 935) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 156) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=9212 (was 9347) 2023-09-17 20:01:57,944 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-09-17 20:01:57,964 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=769, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=181, ProcessCount=168, AvailableMemoryMB=9211 2023-09-17 20:01:57,964 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-09-17 20:01:57,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 20:01:57,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-17 20:01:57,970 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 20:01:57,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-17 20:01:57,971 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 20:01:57,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-17 20:01:57,974 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:01:57,974 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89 2023-09-17 20:01:57,974 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef empty. 2023-09-17 20:01:57,974 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89 empty. 2023-09-17 20:01:57,975 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:01:57,975 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89 2023-09-17 20:01:57,975 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-17 20:01:57,987 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-17 20:01:57,989 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a775b2db2e39a64cde1f69dcd53aaef, NAME => 'testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:01:57,989 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => cb6397967e45f176df2f77189995ed89, NAME => 'testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:01:58,005 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:58,005 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 0a775b2db2e39a64cde1f69dcd53aaef, disabling compactions & flushes 2023-09-17 20:01:58,005 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,005 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,005 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. after waiting 0 ms 2023-09-17 20:01:58,005 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,005 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,005 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 0a775b2db2e39a64cde1f69dcd53aaef: 2023-09-17 20:01:58,005 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:58,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing cb6397967e45f176df2f77189995ed89, disabling compactions & flushes 2023-09-17 20:01:58,006 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:58,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:58,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. after waiting 0 ms 2023-09-17 20:01:58,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:58,006 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:58,006 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for cb6397967e45f176df2f77189995ed89: 2023-09-17 20:01:58,009 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 20:01:58,010 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980918010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980918010"}]},"ts":"1694980918010"} 2023-09-17 20:01:58,010 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980918010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980918010"}]},"ts":"1694980918010"} 2023-09-17 20:01:58,013 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 20:01:58,014 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 20:01:58,014 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980918014"}]},"ts":"1694980918014"} 2023-09-17 20:01:58,015 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-17 20:01:58,020 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:01:58,021 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:01:58,022 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:01:58,022 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:01:58,022 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:01:58,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a775b2db2e39a64cde1f69dcd53aaef, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cb6397967e45f176df2f77189995ed89, ASSIGN}] 2023-09-17 20:01:58,027 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cb6397967e45f176df2f77189995ed89, ASSIGN 2023-09-17 20:01:58,027 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a775b2db2e39a64cde1f69dcd53aaef, ASSIGN 2023-09-17 20:01:58,028 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cb6397967e45f176df2f77189995ed89, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41855,1694980876397; forceNewPlan=false, retain=false 2023-09-17 20:01:58,029 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a775b2db2e39a64cde1f69dcd53aaef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35419,1694980876302; forceNewPlan=false, retain=false 2023-09-17 20:01:58,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-17 20:01:58,178 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 20:01:58,181 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0a775b2db2e39a64cde1f69dcd53aaef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,181 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=cb6397967e45f176df2f77189995ed89, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,181 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980918181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980918181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980918181"}]},"ts":"1694980918181"} 2023-09-17 20:01:58,181 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980918181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980918181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980918181"}]},"ts":"1694980918181"} 2023-09-17 20:01:58,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 0a775b2db2e39a64cde1f69dcd53aaef, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:01:58,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure cb6397967e45f176df2f77189995ed89, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:01:58,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-17 20:01:58,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:58,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a775b2db2e39a64cde1f69dcd53aaef, NAME => 'testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 20:01:58,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb6397967e45f176df2f77189995ed89, NAME => 'testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 20:01:58,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. service=AccessControlService 2023-09-17 20:01:58,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. service=AccessControlService 2023-09-17 20:01:58,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:58,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:01:58,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports cb6397967e45f176df2f77189995ed89 2023-09-17 20:01:58,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:01:58,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:58,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:01:58,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb6397967e45f176df2f77189995ed89 2023-09-17 20:01:58,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:01:58,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb6397967e45f176df2f77189995ed89 2023-09-17 20:01:58,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:01:58,348 INFO [StoreOpener-0a775b2db2e39a64cde1f69dcd53aaef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:01:58,348 INFO [StoreOpener-cb6397967e45f176df2f77189995ed89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cb6397967e45f176df2f77189995ed89 2023-09-17 20:01:58,349 DEBUG [StoreOpener-0a775b2db2e39a64cde1f69dcd53aaef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/cf 2023-09-17 20:01:58,350 DEBUG [StoreOpener-0a775b2db2e39a64cde1f69dcd53aaef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/cf 2023-09-17 20:01:58,350 DEBUG [StoreOpener-cb6397967e45f176df2f77189995ed89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/cf 2023-09-17 20:01:58,350 DEBUG [StoreOpener-cb6397967e45f176df2f77189995ed89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/cf 2023-09-17 20:01:58,350 INFO [StoreOpener-cb6397967e45f176df2f77189995ed89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb6397967e45f176df2f77189995ed89 columnFamilyName cf 2023-09-17 20:01:58,350 INFO [StoreOpener-0a775b2db2e39a64cde1f69dcd53aaef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a775b2db2e39a64cde1f69dcd53aaef columnFamilyName cf 2023-09-17 20:01:58,351 INFO [StoreOpener-cb6397967e45f176df2f77189995ed89-1] regionserver.HStore(310): Store=cb6397967e45f176df2f77189995ed89/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:58,351 INFO [StoreOpener-0a775b2db2e39a64cde1f69dcd53aaef-1] regionserver.HStore(310): Store=0a775b2db2e39a64cde1f69dcd53aaef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:01:58,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89 2023-09-17 20:01:58,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:01:58,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89 2023-09-17 20:01:58,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:01:58,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:01:58,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb6397967e45f176df2f77189995ed89 2023-09-17 20:01:58,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:58,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:01:58,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb6397967e45f176df2f77189995ed89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64873746, jitterRate=-0.033305853605270386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:01:58,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb6397967e45f176df2f77189995ed89: 2023-09-17 20:01:58,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a775b2db2e39a64cde1f69dcd53aaef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62549556, jitterRate=-0.06793898344039917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:01:58,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a775b2db2e39a64cde1f69dcd53aaef: 2023-09-17 20:01:58,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef., pid=45, masterSystemTime=1694980918335 2023-09-17 20:01:58,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89., pid=46, masterSystemTime=1694980918336 2023-09-17 20:01:58,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,362 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0a775b2db2e39a64cde1f69dcd53aaef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:58,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:58,362 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980918361"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980918361"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980918361"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980918361"}]},"ts":"1694980918361"} 2023-09-17 20:01:58,362 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=cb6397967e45f176df2f77189995ed89, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,362 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980918362"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980918362"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980918362"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980918362"}]},"ts":"1694980918362"} 2023-09-17 20:01:58,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-17 20:01:58,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 0a775b2db2e39a64cde1f69dcd53aaef, server=jenkins-hbase4.apache.org,35419,1694980876302 in 180 msec 2023-09-17 20:01:58,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-17 20:01:58,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure cb6397967e45f176df2f77189995ed89, server=jenkins-hbase4.apache.org,41855,1694980876397 in 180 msec 2023-09-17 20:01:58,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a775b2db2e39a64cde1f69dcd53aaef, ASSIGN in 344 msec 2023-09-17 20:01:58,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-17 20:01:58,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cb6397967e45f176df2f77189995ed89, ASSIGN in 344 msec 2023-09-17 20:01:58,369 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 20:01:58,369 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980918369"}]},"ts":"1694980918369"} 2023-09-17 20:01:58,370 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-17 20:01:58,373 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 20:01:58,373 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-17 20:01:58,374 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-17 20:01:58,376 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:58,376 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:58,376 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:58,376 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:01:58,377 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:58,377 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:58,377 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:58,377 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-17 20:01:58,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 411 msec 2023-09-17 20:01:58,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-17 20:01:58,575 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-17 20:01:58,578 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-17 20:01:58,578 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,580 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:01:58,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 20:01:58,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980918591 (current time:1694980918591). 2023-09-17 20:01:58,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:01:58,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x0fb68359 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:58,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@382f51a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:58,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:58,608 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:58,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fb68359 to 127.0.0.1:62829 2023-09-17 20:01:58,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:58,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x68f6bf9d to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:58,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53615591, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:58,619 DEBUG [hconnection-0x1181b417-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:58,622 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:58,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:58,628 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:58,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68f6bf9d to 127.0.0.1:62829 2023-09-17 20:01:58,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:58,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-17 20:01:58,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:01:58,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 20:01:58,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 20:01:58,634 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 20:01:58,635 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694981518635 2023-09-17 20:01:58,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-17 20:01:58,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 20:01:58,636 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:01:58,636 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:01:58,637 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 20:01:58,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 20:01:58,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-17 20:01:58,640 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 20:01:58,640 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694981518640 2023-09-17 20:01:58,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,652 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-17 20:01:58,652 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:58,653 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-17 20:01:58,653 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-17 20:01:58,653 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,653 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,655 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:58,655 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:58,655 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:58,655 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:58,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:58,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:58,656 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,656 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,656 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,656 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:01:58,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 20:01:58,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,657 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 20:01:58,658 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:58,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,658 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 20:01:58,658 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:58,659 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 20:01:58,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,660 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-17 20:01:58,660 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 20:01:58,660 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 20:01:58,660 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:58,660 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-17 20:01:58,663 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 20:01:58,663 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-17 20:01:58,660 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-17 20:01:58,664 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-17 20:01:58,663 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-17 20:01:58,665 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,665 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:58,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,666 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,666 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:58,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-17 20:01:58,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@107a18fa[Count = 1] remaining members to acquire global barrier 2023-09-17 20:01:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:58,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-17 20:01:58,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@107a18fa[Count = 0] remaining members to acquire global barrier 2023-09-17 20:01:58,670 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-17 20:01:58,670 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,671 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,671 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,671 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,671 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 20:01:58,671 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 20:01:58,672 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:58,672 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,672 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:58,672 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. started... 2023-09-17 20:01:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 20:01:58,672 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. started... 2023-09-17 20:01:58,672 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-17 20:01:58,672 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:01:58,673 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb6397967e45f176df2f77189995ed89: 2023-09-17 20:01:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:01:58,673 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a775b2db2e39a64cde1f69dcd53aaef: 2023-09-17 20:01:58,673 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,674 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:58,674 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,674 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:01:58,674 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:58,674 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:01:58,686 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 20:01:58,686 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:58,686 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-17 20:01:58,690 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. completed. 2023-09-17 20:01:58,690 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:58,690 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. completed. 2023-09-17 20:01:58,691 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,690 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-17 20:01:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:01:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-17 20:01:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:01:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 20:01:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:58,692 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,692 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-17 20:01:58,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:58,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:58,693 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 20:01:58,694 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:58,693 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,694 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-17 20:01:58,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:58,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:58,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:58,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:01:58,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-17 20:01:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:01:58,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-17 20:01:58,701 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-17 20:01:58,701 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:01:58,701 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:01:58,701 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,701 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:01:58,703 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,703 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,703 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:58,703 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,703 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,703 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:58,703 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:58,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:58,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,704 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:58,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:58,704 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:58,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:58,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:58,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,705 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:58,707 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,707 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,708 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,712 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:58,712 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:58,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:58,712 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,712 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:58,712 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:58,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:58,712 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:58,712 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:58,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:58,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:58,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:58,712 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:58,712 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:58,712 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:58,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:58,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-17 20:01:58,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:58,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:58,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:58,714 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:58,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,714 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:01:58,714 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:58,714 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,714 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:58,714 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:58,714 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,714 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 20:01:58,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,736 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:58,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-17 20:01:58,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:01:58,738 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:01:58,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,741 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-17 20:01:58,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,742 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-17 20:01:58,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694980918635Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694980918722 (+87 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694980918722Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694980918722Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694980918727 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694980918735 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694980918741 (+6 ms) 2023-09-17 20:01:58,744 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 20:01:58,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 108 msec 2023-09-17 20:01:58,938 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:58,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-17 20:01:58,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:01:58,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35419] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:01:58,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41855] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:01:58,946 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-17 20:01:58,946 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:58,946 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:01:58,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 20:01:58,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980918956 (current time:1694980918956). 2023-09-17 20:01:58,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:01:58,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x5565ae2f to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:58,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5610cd13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:58,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:58,974 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:58,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5565ae2f to 127.0.0.1:62829 2023-09-17 20:01:58,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:58,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x231d8256 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:01:58,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b7144cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:01:58,985 DEBUG [hconnection-0xb5962e4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:58,986 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:58,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:01:58,992 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:01:58,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x231d8256 to 127.0.0.1:62829 2023-09-17 20:01:58,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:01:58,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-17 20:01:58,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:01:58,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 20:01:58,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 20:01:58,997 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 20:01:58,998 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694981518998 2023-09-17 20:01:58,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-17 20:01:58,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-17 20:01:59,000 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:01:59,000 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:01:59,001 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-17 20:01:59,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 20:01:59,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-17 20:01:59,003 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 20:01:59,004 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694981519004 2023-09-17 20:01:59,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-17 20:01:59,016 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-17 20:01:59,016 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:59,018 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-17 20:01:59,018 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-17 20:01:59,018 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,018 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,019 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,020 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:59,020 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:59,020 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:59,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:59,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:59,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:59,020 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,020 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:59,020 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,021 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:01:59,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-17 20:01:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,021 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 20:01:59,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-17 20:01:59,022 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 20:01:59,022 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:59,023 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 20:01:59,023 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-17 20:01:59,023 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-17 20:01:59,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-17 20:01:59,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-17 20:01:59,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 20:01:59,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-17 20:01:59,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-17 20:01:59,023 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 20:01:59,023 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:59,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-17 20:01:59,023 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-17 20:01:59,024 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 20:01:59,024 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:01:59,024 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-17 20:01:59,025 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-17 20:01:59,025 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-17 20:01:59,025 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-17 20:01:59,025 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-17 20:01:59,027 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,027 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:59,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:59,029 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:59,029 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,030 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:01:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 20:01:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:59,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-17 20:01:59,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ac54ec9[Count = 1] remaining members to acquire global barrier 2023-09-17 20:01:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 20:01:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:59,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-17 20:01:59,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ac54ec9[Count = 0] remaining members to acquire global barrier 2023-09-17 20:01:59,033 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-17 20:01:59,033 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,034 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,034 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,034 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,035 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 20:01:59,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,035 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-17 20:01:59,035 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 20:01:59,035 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:01:59,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,035 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-17 20:01:59,035 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:59,035 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,035 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:59,035 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. started... 2023-09-17 20:01:59,035 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:59,035 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cb6397967e45f176df2f77189995ed89 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-17 20:01:59,035 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,036 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:01:59,036 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:01:59,036 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:01:59,036 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:59,036 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. started... 2023-09-17 20:01:59,036 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a775b2db2e39a64cde1f69dcd53aaef 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-17 20:01:59,037 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 20:01:59,037 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:59,037 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-17 20:01:59,067 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091701b1870ca3fe4931b3ca4993a6be55a6 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091701b1870ca3fe4931b3ca4993a6be55a6 2023-09-17 20:01:59,070 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309176621a816a3ee4a889d181f06a613aed0 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309176621a816a3ee4a889d181f06a613aed0 2023-09-17 20:01:59,083 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/.tmp/cf/456c5e9f925a4a708bbf1814e493292a 2023-09-17 20:01:59,085 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/.tmp/cf/e558b80dbf5b45039864b98c424ed575 2023-09-17 20:01:59,089 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/.tmp/cf/456c5e9f925a4a708bbf1814e493292a as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/cf/456c5e9f925a4a708bbf1814e493292a 2023-09-17 20:01:59,090 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/.tmp/cf/e558b80dbf5b45039864b98c424ed575 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/cf/e558b80dbf5b45039864b98c424ed575 2023-09-17 20:01:59,095 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/cf/456c5e9f925a4a708bbf1814e493292a, entries=2, sequenceid=6, filesize=5.2 K 2023-09-17 20:01:59,095 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/cf/e558b80dbf5b45039864b98c424ed575, entries=48, sequenceid=6, filesize=12.9 K 2023-09-17 20:01:59,096 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 0a775b2db2e39a64cde1f69dcd53aaef in 60ms, sequenceid=6, compaction requested=false 2023-09-17 20:01:59,096 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-17 20:01:59,096 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for cb6397967e45f176df2f77189995ed89 in 61ms, sequenceid=6, compaction requested=false 2023-09-17 20:01:59,096 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a775b2db2e39a64cde1f69dcd53aaef: 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb6397967e45f176df2f77189995ed89: 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/cf/456c5e9f925a4a708bbf1814e493292a] hfiles 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/cf/e558b80dbf5b45039864b98c424ed575] hfiles 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/cf/e558b80dbf5b45039864b98c424ed575 for snapshot=snaptb0-testConsecutiveExports 2023-09-17 20:01:59,098 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/cf/456c5e9f925a4a708bbf1814e493292a for snapshot=snaptb0-testConsecutiveExports 2023-09-17 20:01:59,100 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:59,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-17 20:01:59,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:01:59,102 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:01:59,108 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. completed. 2023-09-17 20:01:59,108 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,108 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. completed. 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-17 20:01:59,108 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-17 20:01:59,108 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:01:59,112 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 20:01:59,112 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,112 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-17 20:01:59,112 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:59,112 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:59,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:59,112 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,114 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-17 20:01:59,112 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-17 20:01:59,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:59,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:59,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 20:01:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:59,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 20:01:59,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:01:59,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-17 20:01:59,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:59,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:59,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:59,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:59,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 20:01:59,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:59,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 20:01:59,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:01:59,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-17 20:01:59,123 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-17 20:01:59,124 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:01:59,124 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:01:59,124 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-17 20:01:59,124 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:01:59,127 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:01:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:01:59,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:59,127 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:59,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,127 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:59,128 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:01:59,128 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 20:01:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,129 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:01:59,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 20:01:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:01:59,130 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-17 20:01:59,131 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,131 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:59,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:59,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:59,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:59,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:01:59,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:59,138 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:01:59,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:01:59,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-17 20:01:59,138 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-17 20:01:59,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:59,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:01:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:59,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-17 20:01:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:01:59,140 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:01:59,140 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,141 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:01:59,141 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,141 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:01:59,141 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:01:59,141 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:59,141 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:59,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:01:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:01:59,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309176621a816a3ee4a889d181f06a613aed0, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091701b1870ca3fe4931b3ca4993a6be55a6] mob files 2023-09-17 20:01:59,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309176621a816a3ee4a889d181f06a613aed0 2023-09-17 20:01:59,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091701b1870ca3fe4931b3ca4993a6be55a6 2023-09-17 20:01:59,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-17 20:01:59,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,176 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-17 20:01:59,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,177 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694980918998Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694980919155 (+157 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694980919155Loading Region manifests for snaptb0-testConsecutiveExports at 1694980919156 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1694980919159 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694980919168 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694980919176 (+8 ms) 2023-09-17 20:01:59,179 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-17 20:01:59,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 179 msec 2023-09-17 20:01:59,302 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:01:59,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-17 20:01:59,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:01:59,304 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303 2023-09-17 20:01:59,304 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303, srcFsUri=hdfs://localhost:36291, srcDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:59,326 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:01:59,326 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3b0c3bc6, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,326 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c, snapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-17 20:01:59,334 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 20:01:59,350 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:59,350 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:59,351 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 20:01:59,351 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:00,229 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-7283445175916546932.jar 2023-09-17 20:02:00,229 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:00,229 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:00,295 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-5639353413440041225.jar 2023-09-17 20:02:00,296 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:00,296 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:00,297 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:00,297 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:00,297 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:00,298 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:00,298 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 20:02:00,298 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 20:02:00,299 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 20:02:00,300 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 20:02:00,300 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 20:02:00,301 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 20:02:00,301 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 20:02:00,302 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 20:02:00,302 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 20:02:00,303 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 20:02:00,304 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:00,305 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:00,306 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:00,306 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:00,306 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:00,307 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:00,308 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:00,657 WARN [Listener at jenkins-hbase4.apache.org/39363] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 20:02:00,660 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-17 20:02:00,662 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-17 20:02:02,240 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:02,240 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:02,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0002_000001 (auth:SIMPLE) 2023-09-17 20:02:03,038 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0003_000001 (auth:SIMPLE) 2023-09-17 20:02:03,245 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 20:02:06,743 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0003_000001 (auth:SIMPLE) 2023-09-17 20:02:08,956 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0003_000001 (auth:SIMPLE) 2023-09-17 20:02:11,357 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0003_000001 (auth:SIMPLE) 2023-09-17 20:02:12,816 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 20:02:12,816 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 20:02:12,820 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-17 20:02:12,820 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 20:02:12,821 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 20:02:12,821 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 20:02:12,824 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-17 20:02:12,824 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-17 20:02:12,824 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2faacca4 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 20:02:12,824 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-17 20:02:12,824 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-17 20:02:12,825 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303, srcFsUri=hdfs://localhost:36291, srcDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:02:12,847 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:02:12,847 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@44a2c2ed, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 20:02:12,847 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c, snapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-17 20:02:12,858 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-17 20:02:12,869 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:12,870 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:12,870 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:12,871 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:13,739 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-6624757505337940666.jar 2023-09-17 20:02:13,739 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:13,739 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:13,805 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-3425612793095230252.jar 2023-09-17 20:02:13,806 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:13,806 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:13,807 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:13,807 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:13,807 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:13,808 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:13,808 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 20:02:13,808 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 20:02:13,809 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 20:02:13,809 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 20:02:13,810 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 20:02:13,810 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 20:02:13,810 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 20:02:13,811 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 20:02:13,811 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 20:02:13,812 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 20:02:13,812 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:13,812 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:13,813 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:13,813 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:13,813 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:13,814 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:13,815 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:14,199 WARN [Listener at jenkins-hbase4.apache.org/39363] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 20:02:14,201 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-17 20:02:14,203 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-17 20:02:17,529 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:17,529 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:17,532 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0003_000001 (auth:SIMPLE) 2023-09-17 20:02:18,252 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0004_000001 (auth:SIMPLE) 2023-09-17 20:02:21,850 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0004_000001 (auth:SIMPLE) 2023-09-17 20:02:24,066 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0004_000001 (auth:SIMPLE) 2023-09-17 20:02:26,343 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0004_000001 (auth:SIMPLE) 2023-09-17 20:02:28,361 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 20:02:28,362 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 20:02:28,364 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-17 20:02:28,365 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 20:02:28,365 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 20:02:28,365 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 20:02:28,368 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-17 20:02:28,368 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-17 20:02:28,368 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2faacca4 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-17 20:02:28,368 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-17 20:02:28,368 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/local-export-1694980919303/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-17 20:02:28,380 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-17 20:02:28,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-17 20:02:28,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-17 20:02:28,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-17 20:02:28,385 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980948385"}]},"ts":"1694980948385"} 2023-09-17 20:02:28,387 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-17 20:02:28,388 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-17 20:02:28,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a775b2db2e39a64cde1f69dcd53aaef, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cb6397967e45f176df2f77189995ed89, UNASSIGN}] 2023-09-17 20:02:28,391 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a775b2db2e39a64cde1f69dcd53aaef, UNASSIGN 2023-09-17 20:02:28,391 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cb6397967e45f176df2f77189995ed89, UNASSIGN 2023-09-17 20:02:28,391 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0a775b2db2e39a64cde1f69dcd53aaef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:28,391 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=cb6397967e45f176df2f77189995ed89, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:28,391 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980948391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980948391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980948391"}]},"ts":"1694980948391"} 2023-09-17 20:02:28,392 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980948391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980948391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980948391"}]},"ts":"1694980948391"} 2023-09-17 20:02:28,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 0a775b2db2e39a64cde1f69dcd53aaef, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:02:28,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure cb6397967e45f176df2f77189995ed89, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:02:28,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-17 20:02:28,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:02:28,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a775b2db2e39a64cde1f69dcd53aaef, disabling compactions & flushes 2023-09-17 20:02:28,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:02:28,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:02:28,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. after waiting 0 ms 2023-09-17 20:02:28,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:02:28,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cb6397967e45f176df2f77189995ed89 2023-09-17 20:02:28,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb6397967e45f176df2f77189995ed89, disabling compactions & flushes 2023-09-17 20:02:28,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:02:28,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:02:28,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. after waiting 0 ms 2023-09-17 20:02:28,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:02:28,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:02:28,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:02:28,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:02:28,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:02:28,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef. 2023-09-17 20:02:28,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89. 2023-09-17 20:02:28,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a775b2db2e39a64cde1f69dcd53aaef: 2023-09-17 20:02:28,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb6397967e45f176df2f77189995ed89: 2023-09-17 20:02:28,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cb6397967e45f176df2f77189995ed89 2023-09-17 20:02:28,562 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=cb6397967e45f176df2f77189995ed89, regionState=CLOSED 2023-09-17 20:02:28,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:02:28,562 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980948562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980948562"}]},"ts":"1694980948562"} 2023-09-17 20:02:28,563 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0a775b2db2e39a64cde1f69dcd53aaef, regionState=CLOSED 2023-09-17 20:02:28,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694980948563"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980948563"}]},"ts":"1694980948563"} 2023-09-17 20:02:28,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-17 20:02:28,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure cb6397967e45f176df2f77189995ed89, server=jenkins-hbase4.apache.org,41855,1694980876397 in 170 msec 2023-09-17 20:02:28,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-17 20:02:28,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 0a775b2db2e39a64cde1f69dcd53aaef, server=jenkins-hbase4.apache.org,35419,1694980876302 in 171 msec 2023-09-17 20:02:28,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cb6397967e45f176df2f77189995ed89, UNASSIGN in 177 msec 2023-09-17 20:02:28,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-17 20:02:28,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a775b2db2e39a64cde1f69dcd53aaef, UNASSIGN in 177 msec 2023-09-17 20:02:28,569 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980948569"}]},"ts":"1694980948569"} 2023-09-17 20:02:28,570 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-17 20:02:28,571 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-17 20:02:28,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 191 msec 2023-09-17 20:02:28,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-17 20:02:28,687 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-17 20:02:28,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-17 20:02:28,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 20:02:28,692 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 20:02:28,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-17 20:02:28,692 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 20:02:28,696 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-17 20:02:28,699 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:02:28,699 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89 2023-09-17 20:02:28,700 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 20:02:28,700 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 20:02:28,700 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 20:02:28,700 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 20:02:28,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-17 20:02:28,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-17 20:02:28,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-17 20:02:28,701 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 20:02:28,701 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:28,701 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/recovered.edits] 2023-09-17 20:02:28,701 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 20:02:28,701 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:28,701 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-17 20:02:28,701 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:28,702 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:28,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-17 20:02:28,702 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-17 20:02:28,702 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/recovered.edits] 2023-09-17 20:02:28,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-17 20:02:28,706 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/cf/e558b80dbf5b45039864b98c424ed575 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/cf/e558b80dbf5b45039864b98c424ed575 2023-09-17 20:02:28,706 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/cf/456c5e9f925a4a708bbf1814e493292a to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/cf/456c5e9f925a4a708bbf1814e493292a 2023-09-17 20:02:28,709 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89/recovered.edits/9.seqid 2023-09-17 20:02:28,709 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef/recovered.edits/9.seqid 2023-09-17 20:02:28,709 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/cb6397967e45f176df2f77189995ed89 2023-09-17 20:02:28,710 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testConsecutiveExports/0a775b2db2e39a64cde1f69dcd53aaef 2023-09-17 20:02:28,710 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-17 20:02:28,710 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-17 20:02:28,711 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-17 20:02:28,714 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309176621a816a3ee4a889d181f06a613aed0 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309176621a816a3ee4a889d181f06a613aed0 2023-09-17 20:02:28,715 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091701b1870ca3fe4931b3ca4993a6be55a6 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091701b1870ca3fe4931b3ca4993a6be55a6 2023-09-17 20:02:28,716 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-17 20:02:28,718 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 20:02:28,720 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-17 20:02:28,722 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-17 20:02:28,723 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 20:02:28,723 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-17 20:02:28,724 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980948724"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:28,724 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980948724"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:28,729 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 20:02:28,729 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a775b2db2e39a64cde1f69dcd53aaef, NAME => 'testtb-testConsecutiveExports,,1694980917966.0a775b2db2e39a64cde1f69dcd53aaef.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cb6397967e45f176df2f77189995ed89, NAME => 'testtb-testConsecutiveExports,1,1694980917966.cb6397967e45f176df2f77189995ed89.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 20:02:28,729 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-17 20:02:28,729 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694980948729"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:28,731 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-17 20:02:28,733 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-17 20:02:28,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-09-17 20:02:28,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-17 20:02:28,804 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-17 20:02:28,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-17 20:02:28,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-17 20:02:28,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-17 20:02:28,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-17 20:02:28,839 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 769), OpenFileDescriptor=899 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 181), ProcessCount=168 (was 168), AvailableMemoryMB=9121 (was 9211) 2023-09-17 20:02:28,840 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-09-17 20:02:28,858 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=154, ProcessCount=168, AvailableMemoryMB=9120 2023-09-17 20:02:28,858 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-09-17 20:02:28,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 20:02:28,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:28,863 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 20:02:28,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-17 20:02:28,864 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 20:02:28,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-17 20:02:28,866 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:28,866 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:28,867 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558 empty. 2023-09-17 20:02:28,867 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211 empty. 2023-09-17 20:02:28,867 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:28,867 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:28,867 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-17 20:02:28,878 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-17 20:02:28,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => a5d3dcae68bdc336fd967482845cb558, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:02:28,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c96fc4af86c2538ce8581d298ab81211, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:02:28,886 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing a5d3dcae68bdc336fd967482845cb558, disabling compactions & flushes 2023-09-17 20:02:28,887 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. after waiting 0 ms 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:28,887 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for a5d3dcae68bdc336fd967482845cb558: 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c96fc4af86c2538ce8581d298ab81211, disabling compactions & flushes 2023-09-17 20:02:28,887 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. after waiting 0 ms 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:28,887 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:28,887 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c96fc4af86c2538ce8581d298ab81211: 2023-09-17 20:02:28,889 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 20:02:28,890 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980948890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980948890"}]},"ts":"1694980948890"} 2023-09-17 20:02:28,890 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980948890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980948890"}]},"ts":"1694980948890"} 2023-09-17 20:02:28,892 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 20:02:28,893 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 20:02:28,893 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980948893"}]},"ts":"1694980948893"} 2023-09-17 20:02:28,894 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-17 20:02:28,898 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:02:28,899 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:02:28,899 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:02:28,899 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:02:28,899 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:02:28,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a5d3dcae68bdc336fd967482845cb558, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c96fc4af86c2538ce8581d298ab81211, ASSIGN}] 2023-09-17 20:02:28,902 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c96fc4af86c2538ce8581d298ab81211, ASSIGN 2023-09-17 20:02:28,902 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a5d3dcae68bdc336fd967482845cb558, ASSIGN 2023-09-17 20:02:28,903 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c96fc4af86c2538ce8581d298ab81211, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41855,1694980876397; forceNewPlan=false, retain=false 2023-09-17 20:02:28,903 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a5d3dcae68bdc336fd967482845cb558, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35419,1694980876302; forceNewPlan=false, retain=false 2023-09-17 20:02:28,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-17 20:02:29,053 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 20:02:29,055 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a5d3dcae68bdc336fd967482845cb558, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,055 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c96fc4af86c2538ce8581d298ab81211, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,056 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980949055"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980949055"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980949055"}]},"ts":"1694980949055"} 2023-09-17 20:02:29,056 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980949055"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980949055"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980949055"}]},"ts":"1694980949055"} 2023-09-17 20:02:29,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure a5d3dcae68bdc336fd967482845cb558, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:02:29,058 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure c96fc4af86c2538ce8581d298ab81211, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:02:29,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-17 20:02:29,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:29,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a5d3dcae68bdc336fd967482845cb558, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 20:02:29,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c96fc4af86c2538ce8581d298ab81211, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. service=AccessControlService 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. service=AccessControlService 2023-09-17 20:02:29,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:02:29,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:29,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:29,214 INFO [StoreOpener-c96fc4af86c2538ce8581d298ab81211-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:29,214 INFO [StoreOpener-a5d3dcae68bdc336fd967482845cb558-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:29,218 DEBUG [StoreOpener-c96fc4af86c2538ce8581d298ab81211-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/cf 2023-09-17 20:02:29,218 DEBUG [StoreOpener-a5d3dcae68bdc336fd967482845cb558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/cf 2023-09-17 20:02:29,218 DEBUG [StoreOpener-a5d3dcae68bdc336fd967482845cb558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/cf 2023-09-17 20:02:29,218 DEBUG [StoreOpener-c96fc4af86c2538ce8581d298ab81211-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/cf 2023-09-17 20:02:29,219 INFO [StoreOpener-a5d3dcae68bdc336fd967482845cb558-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5d3dcae68bdc336fd967482845cb558 columnFamilyName cf 2023-09-17 20:02:29,219 INFO [StoreOpener-c96fc4af86c2538ce8581d298ab81211-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c96fc4af86c2538ce8581d298ab81211 columnFamilyName cf 2023-09-17 20:02:29,220 INFO [StoreOpener-a5d3dcae68bdc336fd967482845cb558-1] regionserver.HStore(310): Store=a5d3dcae68bdc336fd967482845cb558/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:02:29,220 INFO [StoreOpener-c96fc4af86c2538ce8581d298ab81211-1] regionserver.HStore(310): Store=c96fc4af86c2538ce8581d298ab81211/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:02:29,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:29,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:29,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:29,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:29,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:29,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:29,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:02:29,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:02:29,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c96fc4af86c2538ce8581d298ab81211; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65148132, jitterRate=-0.029217183589935303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:02:29,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a5d3dcae68bdc336fd967482845cb558; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71851724, jitterRate=0.0706741213798523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:02:29,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c96fc4af86c2538ce8581d298ab81211: 2023-09-17 20:02:29,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a5d3dcae68bdc336fd967482845cb558: 2023-09-17 20:02:29,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211., pid=61, masterSystemTime=1694980949210 2023-09-17 20:02:29,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558., pid=60, masterSystemTime=1694980949209 2023-09-17 20:02:29,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:29,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:29,231 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c96fc4af86c2538ce8581d298ab81211, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,231 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980949230"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980949230"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980949230"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980949230"}]},"ts":"1694980949230"} 2023-09-17 20:02:29,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:29,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:29,231 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a5d3dcae68bdc336fd967482845cb558, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,231 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980949231"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980949231"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980949231"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980949231"}]},"ts":"1694980949231"} 2023-09-17 20:02:29,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-17 20:02:29,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure c96fc4af86c2538ce8581d298ab81211, server=jenkins-hbase4.apache.org,41855,1694980876397 in 174 msec 2023-09-17 20:02:29,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-17 20:02:29,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure a5d3dcae68bdc336fd967482845cb558, server=jenkins-hbase4.apache.org,35419,1694980876302 in 176 msec 2023-09-17 20:02:29,236 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c96fc4af86c2538ce8581d298ab81211, ASSIGN in 335 msec 2023-09-17 20:02:29,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-17 20:02:29,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a5d3dcae68bdc336fd967482845cb558, ASSIGN in 336 msec 2023-09-17 20:02:29,237 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 20:02:29,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980949237"}]},"ts":"1694980949237"} 2023-09-17 20:02:29,239 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-17 20:02:29,241 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 20:02:29,241 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-17 20:02:29,242 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-17 20:02:29,244 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:29,244 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:29,244 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:29,244 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:29,246 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:29,246 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:29,246 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:29,246 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:29,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 385 msec 2023-09-17 20:02:29,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-17 20:02:29,467 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-17 20:02:29,470 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,470 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:29,471 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:02:29,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 20:02:29,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980949484 (current time:1694980949484). 2023-09-17 20:02:29,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:02:29,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x2df47f02 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:29,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8890a50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:29,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:29,494 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:29,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2df47f02 to 127.0.0.1:62829 2023-09-17 20:02:29,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:29,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x46bd7837 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:29,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48bf138d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:29,502 DEBUG [hconnection-0x8244b40-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:29,505 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:29,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:29,510 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:29,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46bd7837 to 127.0.0.1:62829 2023-09-17 20:02:29,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:29,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-17 20:02:29,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:02:29,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 20:02:29,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 20:02:29,515 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 20:02:29,516 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694981549516 2023-09-17 20:02:29,516 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 20:02:29,517 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:02:29,517 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:02:29,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 20:02:29,518 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 20:02:29,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-17 20:02:29,520 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 20:02:29,521 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694981549521 2023-09-17 20:02:29,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,529 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-17 20:02:29,529 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:29,530 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-17 20:02:29,530 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-17 20:02:29,530 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,530 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,533 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,533 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,533 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,533 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,533 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,533 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,534 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,534 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,534 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-17 20:02:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,534 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:29,535 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 20:02:29,535 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 20:02:29,535 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 20:02:29,536 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 20:02:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-17 20:02:29,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,536 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 20:02:29,536 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,537 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 20:02:29,537 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 20:02:29,537 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 20:02:29,537 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 20:02:29,537 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,537 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 20:02:29,537 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:29,538 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 20:02:29,538 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 20:02:29,538 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 20:02:29,538 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,538 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,539 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,539 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,539 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:29,540 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,540 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,540 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,540 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,540 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,540 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-17 20:02:29,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@598d0fcc[Count = 1] remaining members to acquire global barrier 2023-09-17 20:02:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-17 20:02:29,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@598d0fcc[Count = 0] remaining members to acquire global barrier 2023-09-17 20:02:29,544 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-17 20:02:29,544 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 20:02:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,547 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 20:02:29,547 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 20:02:29,547 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 20:02:29,547 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:29,547 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,547 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. started... 2023-09-17 20:02:29,547 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:29,547 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:02:29,548 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. started... 2023-09-17 20:02:29,547 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:29,548 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:29,547 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:29,548 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:29,548 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a5d3dcae68bdc336fd967482845cb558: 2023-09-17 20:02:29,548 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c96fc4af86c2538ce8581d298ab81211: 2023-09-17 20:02:29,547 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:02:29,549 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,549 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,549 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:29,549 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:29,549 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:02:29,549 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:02:29,552 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 20:02:29,552 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:29,552 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 20:02:29,558 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. completed. 2023-09-17 20:02:29,558 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:29,558 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:29,558 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:29,558 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,558 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 20:02:29,558 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. completed. 2023-09-17 20:02:29,558 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:02:29,559 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:29,559 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:29,559 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:29,559 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,559 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 20:02:29,559 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:02:29,560 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 20:02:29,560 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,560 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:29,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,561 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 20:02:29,562 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,562 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 20:02:29,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,562 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:29,562 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 20:02:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:02:29,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-17 20:02:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:02:29,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-17 20:02:29,569 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-17 20:02:29,569 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:02:29,569 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:02:29,569 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,569 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:02:29,571 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,571 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,571 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,572 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,573 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,573 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,575 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,575 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,576 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,578 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,578 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,578 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,578 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,578 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,578 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,578 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,578 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:29,578 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,579 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,578 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,578 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,580 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:02:29,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,580 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,581 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,581 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,581 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,581 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,581 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,581 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 20:02:29,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-17 20:02:29,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,609 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694980949516Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694980949588 (+72 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694980949588Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694980949588Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694980949593 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694980949602 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694980949609 (+7 ms) 2023-09-17 20:02:29,611 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 20:02:29,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 94 msec 2023-09-17 20:02:29,617 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:29,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-17 20:02:29,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:02:29,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35419] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:02:29,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41855] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:02:29,625 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,625 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:29,625 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:02:29,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 20:02:29,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980949635 (current time:1694980949635). 2023-09-17 20:02:29,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:02:29,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x7b14ccc1 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:29,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27581930, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:29,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:29,646 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:29,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b14ccc1 to 127.0.0.1:62829 2023-09-17 20:02:29,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:29,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x0dc7875a to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:29,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@506830e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:29,654 DEBUG [hconnection-0x371e2243-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:29,657 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:29,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:29,662 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:29,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dc7875a to 127.0.0.1:62829 2023-09-17 20:02:29,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:29,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-17 20:02:29,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:02:29,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 20:02:29,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 20:02:29,667 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 20:02:29,667 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694981549667 2023-09-17 20:02:29,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-17 20:02:29,669 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:02:29,669 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:02:29,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 20:02:29,671 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-17 20:02:29,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-09-17 20:02:29,673 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 20:02:29,673 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694981549673 2023-09-17 20:02:29,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,684 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-17 20:02:29,684 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:29,685 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-17 20:02:29,685 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-17 20:02:29,685 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,685 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,687 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,687 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,687 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,687 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,688 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,688 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,688 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,688 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:02:29,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-17 20:02:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,689 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 20:02:29,689 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 20:02:29,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,689 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:29,689 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-17 20:02:29,690 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 20:02:29,690 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:29,689 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:29,691 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 20:02:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-17 20:02:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 20:02:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 20:02:29,690 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 20:02:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-17 20:02:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 20:02:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-17 20:02:29,694 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,695 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,696 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,696 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,696 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-17 20:02:29,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45f1a302[Count = 1] remaining members to acquire global barrier 2023-09-17 20:02:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-17 20:02:29,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45f1a302[Count = 0] remaining members to acquire global barrier 2023-09-17 20:02:29,701 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-17 20:02:29,701 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,702 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,702 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,702 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,702 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,702 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 20:02:29,702 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 20:02:29,702 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:02:29,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,703 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,703 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:02:29,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,703 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 20:02:29,703 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-17 20:02:29,703 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:29,703 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:29,703 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:29,703 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:29,703 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:29,703 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. started... 2023-09-17 20:02:29,703 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. started... 2023-09-17 20:02:29,703 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:29,703 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a5d3dcae68bdc336fd967482845cb558 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-17 20:02:29,703 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c96fc4af86c2538ce8581d298ab81211 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-17 20:02:29,704 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 20:02:29,704 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:29,704 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 20:02:29,725 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917ae371a3fc58e4e30917e8030c71cb5ed to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917ae371a3fc58e4e30917e8030c71cb5ed 2023-09-17 20:02:29,725 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230917365650ae772648fead9d3ead2294f59e to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917365650ae772648fead9d3ead2294f59e 2023-09-17 20:02:29,745 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/.tmp/cf/f95574d7804045019458f56258e9c9da 2023-09-17 20:02:29,747 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/.tmp/cf/b1b751925aec4bd3a7019387522d2b30 2023-09-17 20:02:29,751 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/.tmp/cf/f95574d7804045019458f56258e9c9da as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/cf/f95574d7804045019458f56258e9c9da 2023-09-17 20:02:29,752 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/.tmp/cf/b1b751925aec4bd3a7019387522d2b30 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/cf/b1b751925aec4bd3a7019387522d2b30 2023-09-17 20:02:29,756 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/cf/f95574d7804045019458f56258e9c9da, entries=46, sequenceid=6, filesize=13.3 K 2023-09-17 20:02:29,757 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for c96fc4af86c2538ce8581d298ab81211 in 54ms, sequenceid=6, compaction requested=false 2023-09-17 20:02:29,757 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-17 20:02:29,757 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/cf/b1b751925aec4bd3a7019387522d2b30, entries=4, sequenceid=6, filesize=5.6 K 2023-09-17 20:02:29,758 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c96fc4af86c2538ce8581d298ab81211: 2023-09-17 20:02:29,758 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,758 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:29,758 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/cf/f95574d7804045019458f56258e9c9da] hfiles 2023-09-17 20:02:29,758 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/cf/f95574d7804045019458f56258e9c9da for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,760 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for a5d3dcae68bdc336fd967482845cb558 in 57ms, sequenceid=6, compaction requested=false 2023-09-17 20:02:29,762 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a5d3dcae68bdc336fd967482845cb558: 2023-09-17 20:02:29,762 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,762 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:29,762 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/cf/b1b751925aec4bd3a7019387522d2b30] hfiles 2023-09-17 20:02:29,762 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/cf/b1b751925aec4bd3a7019387522d2b30 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,769 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:29,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-17 20:02:29,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:02:29,771 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:02:29,771 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. completed. 2023-09-17 20:02:29,771 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:29,772 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:29,772 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:29,772 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,772 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 20:02:29,772 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:02:29,774 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. completed. 2023-09-17 20:02:29,774 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:29,774 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:29,774 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:29,774 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,774 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-17 20:02:29,774 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:02:29,774 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,774 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 20:02:29,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,774 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:29,775 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 20:02:29,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,777 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,777 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-17 20:02:29,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,778 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:29,778 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-17 20:02:29,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:02:29,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-17 20:02:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:02:29,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-17 20:02:29,785 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-17 20:02:29,785 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:02:29,785 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:02:29,785 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,785 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:02:29,789 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,789 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,789 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,789 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,789 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:29,789 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,790 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:29,790 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,790 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:29,791 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,793 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:29,793 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,793 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,797 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,797 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,797 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,797 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,799 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:29,799 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:29,799 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,799 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,799 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:29,799 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:29,799 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,801 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:29,800 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:02:29,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:29,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:29,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:29,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:29,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:29,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917365650ae772648fead9d3ead2294f59e, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917ae371a3fc58e4e30917e8030c71cb5ed] mob files 2023-09-17 20:02:29,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917365650ae772648fead9d3ead2294f59e 2023-09-17 20:02:29,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917ae371a3fc58e4e30917e8030c71cb5ed 2023-09-17 20:02:29,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,829 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-17 20:02:29,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,830 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:29,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694980949668Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694980949809 (+141 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694980949809Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694980949809Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694980949813 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694980949822 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694980949829 (+7 ms) 2023-09-17 20:02:29,832 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-17 20:02:29,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 164 msec 2023-09-17 20:02:29,971 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:29,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-17 20:02:29,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:02:30,000 DEBUG [Listener at jenkins-hbase4.apache.org/39363] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 20:02:30,004 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 20:02:30,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35419] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-17 20:02:30,006 DEBUG [Listener at jenkins-hbase4.apache.org/39363] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 20:02:30,008 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 20:02:30,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41855] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-17 20:02:30,009 DEBUG [Listener at jenkins-hbase4.apache.org/39363] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-17 20:02:30,011 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-17 20:02:30,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-17 20:02:30,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-17 20:02:30,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:30,015 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 20:02:30,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-17 20:02:30,016 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 20:02:30,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-17 20:02:30,018 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,019 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,019 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305 empty. 2023-09-17 20:02:30,019 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284 empty. 2023-09-17 20:02:30,019 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,019 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,019 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-17 20:02:30,028 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-17 20:02:30,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9003223aa96ec665dd11232f1ffe4284, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:02:30,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5cf9c880766407fc30eaa1910889305, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:02:30,039 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:30,039 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9003223aa96ec665dd11232f1ffe4284, disabling compactions & flushes 2023-09-17 20:02:30,039 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,039 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:30,039 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,039 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing b5cf9c880766407fc30eaa1910889305, disabling compactions & flushes 2023-09-17 20:02:30,039 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. after waiting 0 ms 2023-09-17 20:02:30,039 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,040 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,039 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,040 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. after waiting 0 ms 2023-09-17 20:02:30,040 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,040 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,040 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9003223aa96ec665dd11232f1ffe4284: 2023-09-17 20:02:30,040 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,040 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for b5cf9c880766407fc30eaa1910889305: 2023-09-17 20:02:30,042 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 20:02:30,043 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980950043"}]},"ts":"1694980950043"} 2023-09-17 20:02:30,043 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980950043"}]},"ts":"1694980950043"} 2023-09-17 20:02:30,045 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 20:02:30,046 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 20:02:30,046 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980950046"}]},"ts":"1694980950046"} 2023-09-17 20:02:30,047 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-17 20:02:30,050 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:02:30,051 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:02:30,051 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:02:30,051 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:02:30,051 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:02:30,051 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b5cf9c880766407fc30eaa1910889305, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9003223aa96ec665dd11232f1ffe4284, ASSIGN}] 2023-09-17 20:02:30,054 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b5cf9c880766407fc30eaa1910889305, ASSIGN 2023-09-17 20:02:30,054 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9003223aa96ec665dd11232f1ffe4284, ASSIGN 2023-09-17 20:02:30,054 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b5cf9c880766407fc30eaa1910889305, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45281,1694980876357; forceNewPlan=false, retain=false 2023-09-17 20:02:30,054 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9003223aa96ec665dd11232f1ffe4284, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41855,1694980876397; forceNewPlan=false, retain=false 2023-09-17 20:02:30,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-17 20:02:30,205 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 20:02:30,207 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b5cf9c880766407fc30eaa1910889305, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:30,207 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9003223aa96ec665dd11232f1ffe4284, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:30,208 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980950207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980950207"}]},"ts":"1694980950207"} 2023-09-17 20:02:30,208 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980950207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980950207"}]},"ts":"1694980950207"} 2023-09-17 20:02:30,210 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 9003223aa96ec665dd11232f1ffe4284, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:02:30,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure b5cf9c880766407fc30eaa1910889305, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:02:30,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-17 20:02:30,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9003223aa96ec665dd11232f1ffe4284, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.', STARTKEY => '2', ENDKEY => ''} 2023-09-17 20:02:30,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. service=AccessControlService 2023-09-17 20:02:30,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5cf9c880766407fc30eaa1910889305, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.', STARTKEY => '', ENDKEY => '2'} 2023-09-17 20:02:30,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:02:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. service=AccessControlService 2023-09-17 20:02:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:30,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:02:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,370 INFO [StoreOpener-9003223aa96ec665dd11232f1ffe4284-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,370 INFO [StoreOpener-b5cf9c880766407fc30eaa1910889305-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,371 DEBUG [StoreOpener-b5cf9c880766407fc30eaa1910889305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/cf 2023-09-17 20:02:30,371 DEBUG [StoreOpener-b5cf9c880766407fc30eaa1910889305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/cf 2023-09-17 20:02:30,371 DEBUG [StoreOpener-9003223aa96ec665dd11232f1ffe4284-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/cf 2023-09-17 20:02:30,371 DEBUG [StoreOpener-9003223aa96ec665dd11232f1ffe4284-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/cf 2023-09-17 20:02:30,372 INFO [StoreOpener-b5cf9c880766407fc30eaa1910889305-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5cf9c880766407fc30eaa1910889305 columnFamilyName cf 2023-09-17 20:02:30,372 INFO [StoreOpener-9003223aa96ec665dd11232f1ffe4284-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9003223aa96ec665dd11232f1ffe4284 columnFamilyName cf 2023-09-17 20:02:30,372 INFO [StoreOpener-b5cf9c880766407fc30eaa1910889305-1] regionserver.HStore(310): Store=b5cf9c880766407fc30eaa1910889305/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:02:30,372 INFO [StoreOpener-9003223aa96ec665dd11232f1ffe4284-1] regionserver.HStore(310): Store=9003223aa96ec665dd11232f1ffe4284/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:02:30,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:02:30,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:02:30,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9003223aa96ec665dd11232f1ffe4284; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62735926, jitterRate=-0.06516185402870178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:02:30,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5cf9c880766407fc30eaa1910889305; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67354577, jitterRate=0.003661409020423889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:02:30,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9003223aa96ec665dd11232f1ffe4284: 2023-09-17 20:02:30,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5cf9c880766407fc30eaa1910889305: 2023-09-17 20:02:30,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284., pid=69, masterSystemTime=1694980950361 2023-09-17 20:02:30,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305., pid=70, masterSystemTime=1694980950362 2023-09-17 20:02:30,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,382 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9003223aa96ec665dd11232f1ffe4284, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:30,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,382 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950382"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980950382"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980950382"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980950382"}]},"ts":"1694980950382"} 2023-09-17 20:02:30,383 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b5cf9c880766407fc30eaa1910889305, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:30,383 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950382"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980950382"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980950382"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980950382"}]},"ts":"1694980950382"} 2023-09-17 20:02:30,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-17 20:02:30,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 9003223aa96ec665dd11232f1ffe4284, server=jenkins-hbase4.apache.org,41855,1694980876397 in 173 msec 2023-09-17 20:02:30,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-17 20:02:30,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure b5cf9c880766407fc30eaa1910889305, server=jenkins-hbase4.apache.org,45281,1694980876357 in 173 msec 2023-09-17 20:02:30,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9003223aa96ec665dd11232f1ffe4284, ASSIGN in 334 msec 2023-09-17 20:02:30,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-17 20:02:30,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b5cf9c880766407fc30eaa1910889305, ASSIGN in 335 msec 2023-09-17 20:02:30,388 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 20:02:30,389 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980950388"}]},"ts":"1694980950388"} 2023-09-17 20:02:30,390 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-17 20:02:30,392 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 20:02:30,393 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-17 20:02:30,394 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-17 20:02:30,396 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:30,396 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:30,396 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:30,396 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:30,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:30,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:30,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:30,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:30,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:30,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:30,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:30,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:30,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 385 msec 2023-09-17 20:02:30,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-17 20:02:30,620 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-17 20:02:30,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions b5cf9c880766407fc30eaa1910889305, 9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b5cf9c880766407fc30eaa1910889305, 9003223aa96ec665dd11232f1ffe4284], force=true 2023-09-17 20:02:30,651 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b5cf9c880766407fc30eaa1910889305, 9003223aa96ec665dd11232f1ffe4284], force=true 2023-09-17 20:02:30,651 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b5cf9c880766407fc30eaa1910889305, 9003223aa96ec665dd11232f1ffe4284], force=true 2023-09-17 20:02:30,651 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b5cf9c880766407fc30eaa1910889305, 9003223aa96ec665dd11232f1ffe4284], force=true 2023-09-17 20:02:30,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 20:02:30,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b5cf9c880766407fc30eaa1910889305, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9003223aa96ec665dd11232f1ffe4284, UNASSIGN}] 2023-09-17 20:02:30,673 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9003223aa96ec665dd11232f1ffe4284, UNASSIGN 2023-09-17 20:02:30,674 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b5cf9c880766407fc30eaa1910889305, UNASSIGN 2023-09-17 20:02:30,674 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9003223aa96ec665dd11232f1ffe4284, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:30,674 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b5cf9c880766407fc30eaa1910889305, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:30,674 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980950674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980950674"}]},"ts":"1694980950674"} 2023-09-17 20:02:30,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980950674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980950674"}]},"ts":"1694980950674"} 2023-09-17 20:02:30,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 9003223aa96ec665dd11232f1ffe4284, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:02:30,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure b5cf9c880766407fc30eaa1910889305, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:02:30,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 20:02:30,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9003223aa96ec665dd11232f1ffe4284, disabling compactions & flushes 2023-09-17 20:02:30,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. after waiting 0 ms 2023-09-17 20:02:30,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9003223aa96ec665dd11232f1ffe4284 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-17 20:02:30,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5cf9c880766407fc30eaa1910889305, disabling compactions & flushes 2023-09-17 20:02:30,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. after waiting 0 ms 2023-09-17 20:02:30,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b5cf9c880766407fc30eaa1910889305 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-17 20:02:30,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/.tmp/cf/f0b485dc60544563a2e35562f00853aa 2023-09-17 20:02:30,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/.tmp/cf/015adb717ae745559969045451388c75 2023-09-17 20:02:30,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/.tmp/cf/015adb717ae745559969045451388c75 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/cf/015adb717ae745559969045451388c75 2023-09-17 20:02:30,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/.tmp/cf/f0b485dc60544563a2e35562f00853aa as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/cf/f0b485dc60544563a2e35562f00853aa 2023-09-17 20:02:30,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/cf/f0b485dc60544563a2e35562f00853aa, entries=1, sequenceid=5, filesize=4.7 K 2023-09-17 20:02:30,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/cf/015adb717ae745559969045451388c75, entries=1, sequenceid=5, filesize=4.7 K 2023-09-17 20:02:30,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9003223aa96ec665dd11232f1ffe4284 in 22ms, sequenceid=5, compaction requested=false 2023-09-17 20:02:30,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-17 20:02:30,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b5cf9c880766407fc30eaa1910889305 in 22ms, sequenceid=5, compaction requested=false 2023-09-17 20:02:30,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-17 20:02:30,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-17 20:02:30,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-17 20:02:30,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:02:30,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:02:30,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284. 2023-09-17 20:02:30,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9003223aa96ec665dd11232f1ffe4284: 2023-09-17 20:02:30,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305. 2023-09-17 20:02:30,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5cf9c880766407fc30eaa1910889305: 2023-09-17 20:02:30,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:30,864 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9003223aa96ec665dd11232f1ffe4284, regionState=CLOSED 2023-09-17 20:02:30,864 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980950864"}]},"ts":"1694980950864"} 2023-09-17 20:02:30,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:30,865 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b5cf9c880766407fc30eaa1910889305, regionState=CLOSED 2023-09-17 20:02:30,865 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694980950865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980950865"}]},"ts":"1694980950865"} 2023-09-17 20:02:30,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-17 20:02:30,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 9003223aa96ec665dd11232f1ffe4284, server=jenkins-hbase4.apache.org,41855,1694980876397 in 190 msec 2023-09-17 20:02:30,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-17 20:02:30,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure b5cf9c880766407fc30eaa1910889305, server=jenkins-hbase4.apache.org,45281,1694980876357 in 190 msec 2023-09-17 20:02:30,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9003223aa96ec665dd11232f1ffe4284, UNASSIGN in 195 msec 2023-09-17 20:02:30,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-17 20:02:30,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b5cf9c880766407fc30eaa1910889305, UNASSIGN in 199 msec 2023-09-17 20:02:30,910 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-17 20:02:30,912 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950013.b5cf9c880766407fc30eaa1910889305.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:30,912 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694980950013.9003223aa96ec665dd11232f1ffe4284.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:30,913 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:30,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 20:02:30,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=637d4b3318f986575528b873f6168219, ASSIGN}] 2023-09-17 20:02:30,961 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=637d4b3318f986575528b873f6168219, ASSIGN 2023-09-17 20:02:30,961 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=637d4b3318f986575528b873f6168219, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45281,1694980876357; forceNewPlan=false, retain=false 2023-09-17 20:02:31,111 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-17 20:02:31,113 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=637d4b3318f986575528b873f6168219, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,114 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694980951113"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980951113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980951113"}]},"ts":"1694980951113"} 2023-09-17 20:02:31,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 637d4b3318f986575528b873f6168219, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:02:31,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 20:02:31,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. 2023-09-17 20:02:31,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 637d4b3318f986575528b873f6168219, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.', STARTKEY => '', ENDKEY => ''} 2023-09-17 20:02:31,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. service=AccessControlService 2023-09-17 20:02:31,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:02:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 637d4b3318f986575528b873f6168219 2023-09-17 20:02:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 637d4b3318f986575528b873f6168219 2023-09-17 20:02:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 637d4b3318f986575528b873f6168219 2023-09-17 20:02:31,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/.regioninfo 2023-09-17 20:02:31,281 INFO [StoreOpener-637d4b3318f986575528b873f6168219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 637d4b3318f986575528b873f6168219 2023-09-17 20:02:31,281 DEBUG [StoreOpener-637d4b3318f986575528b873f6168219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf 2023-09-17 20:02:31,281 DEBUG [StoreOpener-637d4b3318f986575528b873f6168219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf 2023-09-17 20:02:31,282 INFO [StoreOpener-637d4b3318f986575528b873f6168219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 637d4b3318f986575528b873f6168219 columnFamilyName cf 2023-09-17 20:02:31,310 DEBUG [StoreOpener-637d4b3318f986575528b873f6168219-1] regionserver.HStore(539): loaded hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/015adb717ae745559969045451388c75.b5cf9c880766407fc30eaa1910889305->hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/cf/015adb717ae745559969045451388c75-top 2023-09-17 20:02:31,314 DEBUG [StoreOpener-637d4b3318f986575528b873f6168219-1] regionserver.HStore(539): loaded hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/f0b485dc60544563a2e35562f00853aa.9003223aa96ec665dd11232f1ffe4284->hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/cf/f0b485dc60544563a2e35562f00853aa-top 2023-09-17 20:02:31,315 INFO [StoreOpener-637d4b3318f986575528b873f6168219-1] regionserver.HStore(310): Store=637d4b3318f986575528b873f6168219/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:02:31,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219 2023-09-17 20:02:31,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219 2023-09-17 20:02:31,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 637d4b3318f986575528b873f6168219 2023-09-17 20:02:31,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 637d4b3318f986575528b873f6168219; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66481810, jitterRate=-0.009343832731246948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:02:31,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 637d4b3318f986575528b873f6168219: 2023-09-17 20:02:31,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219., pid=77, masterSystemTime=1694980951267 2023-09-17 20:02:31,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.,because compaction is disabled. 2023-09-17 20:02:31,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. 2023-09-17 20:02:31,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. 2023-09-17 20:02:31,322 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=637d4b3318f986575528b873f6168219, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,323 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694980951322"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980951322"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980951322"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980951322"}]},"ts":"1694980951322"} 2023-09-17 20:02:31,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-17 20:02:31,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 637d4b3318f986575528b873f6168219, server=jenkins-hbase4.apache.org,45281,1694980876357 in 209 msec 2023-09-17 20:02:31,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-17 20:02:31,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=637d4b3318f986575528b873f6168219, ASSIGN in 365 msec 2023-09-17 20:02:31,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b5cf9c880766407fc30eaa1910889305, 9003223aa96ec665dd11232f1ffe4284], force=true in 683 msec 2023-09-17 20:02:31,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-17 20:02:31,758 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-17 20:02:31,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-17 20:02:31,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980951758 (current time:1694980951758). 2023-09-17 20:02:31,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:02:31,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x6094f49f to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:31,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c8f7530, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:31,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:31,769 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:31,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6094f49f to 127.0.0.1:62829 2023-09-17 20:02:31,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:31,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x4a28a486 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:31,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ddf8150, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:31,777 DEBUG [hconnection-0x1aee532e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:31,780 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:31,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:31,785 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:31,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a28a486 to 127.0.0.1:62829 2023-09-17 20:02:31,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:31,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-17 20:02:31,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:02:31,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-17 20:02:31,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-17 20:02:31,790 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-17 20:02:31,791 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694981551791 2023-09-17 20:02:31,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-17 20:02:31,795 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:02:31,795 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:02:31,796 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-17 20:02:31,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-17 20:02:31,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-17 20:02:31,797 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-17 20:02:31,798 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694981551798 2023-09-17 20:02:31,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,809 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-17 20:02:31,809 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:31,810 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-17 20:02:31,810 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-17 20:02:31,810 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,810 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,812 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:31,812 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:31,812 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:31,812 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:31,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:31,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,812 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,812 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,813 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-17 20:02:31,814 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-17 20:02:31,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-17 20:02:31,814 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:31,815 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-17 20:02:31,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,815 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-17 20:02:31,815 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-17 20:02:31,815 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:31,815 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-17 20:02:31,816 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-17 20:02:31,815 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:31,816 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-17 20:02:31,816 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-17 20:02:31,817 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-17 20:02:31,817 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-17 20:02:31,817 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-17 20:02:31,817 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-17 20:02:31,819 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,819 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:31,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:31,819 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:31,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:31,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:31,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:31,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:31,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:31,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-17 20:02:31,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58cde8e[Count = 0] remaining members to acquire global barrier 2023-09-17 20:02:31,822 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-17 20:02:31,822 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,825 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-17 20:02:31,825 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-17 20:02:31,825 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,825 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:02:31,825 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-17 20:02:31,825 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:31,825 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:31,825 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-17 20:02:31,825 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. 2023-09-17 20:02:31,825 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-17 20:02:31,826 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. started... 2023-09-17 20:02:31,826 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:02:31,826 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:02:31,827 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 637d4b3318f986575528b873f6168219: 2023-09-17 20:02:31,827 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,827 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:31,827 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/015adb717ae745559969045451388c75.b5cf9c880766407fc30eaa1910889305->hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/cf/015adb717ae745559969045451388c75-top, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/f0b485dc60544563a2e35562f00853aa.9003223aa96ec665dd11232f1ffe4284->hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/cf/f0b485dc60544563a2e35562f00853aa-top] hfiles 2023-09-17 20:02:31,827 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/015adb717ae745559969045451388c75.b5cf9c880766407fc30eaa1910889305 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,828 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/f0b485dc60544563a2e35562f00853aa.9003223aa96ec665dd11232f1ffe4284 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,828 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-17 20:02:31,828 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-17 20:02:31,828 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:31,828 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:31,828 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-17 20:02:31,829 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-17 20:02:31,839 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. completed. 2023-09-17 20:02:31,839 DEBUG [rs(jenkins-hbase4.apache.org,45281,1694980876357)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. 2023-09-17 20:02:31,840 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:31,840 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:31,840 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,840 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-17 20:02:31,840 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:02:31,845 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-17 20:02:31,845 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,845 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:31,845 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-17 20:02:31,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:31,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:31,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:31,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:31,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:31,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45281,1694980876357': 2023-09-17 20:02:31,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-17 20:02:31,848 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-17 20:02:31,848 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:02:31,848 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:02:31,848 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,848 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:02:31,851 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:31,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:31,851 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:31,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:31,851 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:31,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,852 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:31,852 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:31,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:31,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,854 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:31,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:31,855 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,855 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:31,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:31,857 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:31,857 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,857 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:31,857 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:31,857 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:31,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:31,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:31,857 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:31,857 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:31,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:31,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:31,857 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:31,858 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:31,858 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:31,857 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:31,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:31,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:31,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,858 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:31,858 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:31,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:31,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:31,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:31,858 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:31,859 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:31,859 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:31,859 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,859 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-17 20:02:31,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,878 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694980951791Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694980951858 (+67 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694980951858Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694980951861 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694980951869 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694980951878 (+9 ms) 2023-09-17 20:02:31,881 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-17 20:02:31,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 87 msec 2023-09-17 20:02:31,895 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:31,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-17 20:02:31,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:02:31,896 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896 2023-09-17 20:02:31,896 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36291, tgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896, rawTgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896, srcFsUri=hdfs://localhost:36291, srcDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:02:31,918 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:02:31,918 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1040195739_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,918 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c, snapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-17 20:02:31,927 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:31,949 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:31,950 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:31,950 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:31,950 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:32,517 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0004_000001 (auth:SIMPLE) 2023-09-17 20:02:32,829 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-1070524444097547372.jar 2023-09-17 20:02:32,829 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:32,830 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:32,896 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-7553293235167192263.jar 2023-09-17 20:02:32,897 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:32,897 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:32,898 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:32,898 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:32,898 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:32,899 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:32,899 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 20:02:32,899 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 20:02:32,900 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 20:02:32,900 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 20:02:32,900 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 20:02:32,901 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 20:02:32,901 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 20:02:32,901 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 20:02:32,902 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 20:02:32,902 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 20:02:32,903 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:32,903 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:32,904 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:32,904 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:32,904 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:32,905 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:32,905 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:33,256 WARN [Listener at jenkins-hbase4.apache.org/39363] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 20:02:33,259 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-17 20:02:33,261 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-17 20:02:33,312 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:33,312 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:33,520 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0005_000001 (auth:SIMPLE) 2023-09-17 20:02:34,152 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 20:02:37,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0005_000001 (auth:SIMPLE) 2023-09-17 20:02:39,472 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0005_000001 (auth:SIMPLE) 2023-09-17 20:02:41,857 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0005_000001 (auth:SIMPLE) 2023-09-17 20:02:43,462 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 20:02:43,467 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 20:02:43,477 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,477 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 20:02:43,478 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 20:02:43,478 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,478 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-17 20:02:43,478 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-17 20:02:43,478 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,479 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-17 20:02:43,479 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980951896/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-17 20:02:43,485 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-17 20:02:43,490 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980963489"}]},"ts":"1694980963489"} 2023-09-17 20:02:43,491 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-17 20:02:43,492 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-17 20:02:43,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=637d4b3318f986575528b873f6168219, UNASSIGN}] 2023-09-17 20:02:43,495 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=637d4b3318f986575528b873f6168219, UNASSIGN 2023-09-17 20:02:43,495 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=637d4b3318f986575528b873f6168219, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:43,495 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694980963495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980963495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980963495"}]},"ts":"1694980963495"} 2023-09-17 20:02:43,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 637d4b3318f986575528b873f6168219, server=jenkins-hbase4.apache.org,45281,1694980876357}] 2023-09-17 20:02:43,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-17 20:02:43,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 637d4b3318f986575528b873f6168219 2023-09-17 20:02:43,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 637d4b3318f986575528b873f6168219, disabling compactions & flushes 2023-09-17 20:02:43,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. 2023-09-17 20:02:43,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. 2023-09-17 20:02:43,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. after waiting 0 ms 2023-09-17 20:02:43,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. 2023-09-17 20:02:43,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-17 20:02:43,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:02:43,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219. 2023-09-17 20:02:43,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 637d4b3318f986575528b873f6168219: 2023-09-17 20:02:43,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 637d4b3318f986575528b873f6168219 2023-09-17 20:02:43,665 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=637d4b3318f986575528b873f6168219, regionState=CLOSED 2023-09-17 20:02:43,665 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694980963665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980963665"}]},"ts":"1694980963665"} 2023-09-17 20:02:43,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-17 20:02:43,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 637d4b3318f986575528b873f6168219, server=jenkins-hbase4.apache.org,45281,1694980876357 in 170 msec 2023-09-17 20:02:43,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-17 20:02:43,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=637d4b3318f986575528b873f6168219, UNASSIGN in 175 msec 2023-09-17 20:02:43,670 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980963670"}]},"ts":"1694980963670"} 2023-09-17 20:02:43,671 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-17 20:02:43,672 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-17 20:02:43,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 187 msec 2023-09-17 20:02:43,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-17 20:02:43,792 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-17 20:02:43,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,796 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,796 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,798 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,800 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:43,800 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219 2023-09-17 20:02:43,800 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:43,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,801 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-17 20:02:43,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-17 20:02:43,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-17 20:02:43,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-17 20:02:43,803 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,803 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:43,803 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,803 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,803 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:43,803 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,803 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:43,803 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:43,803 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/recovered.edits] 2023-09-17 20:02:43,803 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/recovered.edits] 2023-09-17 20:02:43,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-17 20:02:43,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:43,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:43,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:43,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:43,806 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/recovered.edits] 2023-09-17 20:02:43,808 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/cf/015adb717ae745559969045451388c75 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/cf/015adb717ae745559969045451388c75 2023-09-17 20:02:43,808 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/015adb717ae745559969045451388c75.b5cf9c880766407fc30eaa1910889305 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/015adb717ae745559969045451388c75.b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:43,810 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/f0b485dc60544563a2e35562f00853aa.9003223aa96ec665dd11232f1ffe4284 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/cf/f0b485dc60544563a2e35562f00853aa.9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:43,810 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/cf/f0b485dc60544563a2e35562f00853aa to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/cf/f0b485dc60544563a2e35562f00853aa 2023-09-17 20:02:43,812 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/recovered.edits/8.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305/recovered.edits/8.seqid 2023-09-17 20:02:43,812 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b5cf9c880766407fc30eaa1910889305 2023-09-17 20:02:43,813 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/recovered.edits/12.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219/recovered.edits/12.seqid 2023-09-17 20:02:43,814 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/recovered.edits/8.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284/recovered.edits/8.seqid 2023-09-17 20:02:43,814 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/637d4b3318f986575528b873f6168219 2023-09-17 20:02:43,814 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9003223aa96ec665dd11232f1ffe4284 2023-09-17 20:02:43,814 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-17 20:02:43,816 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,818 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-17 20:02:43,820 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-17 20:02:43,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-17 20:02:43,821 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980963821"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:43,823 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-17 20:02:43,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 637d4b3318f986575528b873f6168219, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694980950014.637d4b3318f986575528b873f6168219.', STARTKEY => '', ENDKEY => ''}] 2023-09-17 20:02:43,823 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-17 20:02:43,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694980963823"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:43,824 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-17 20:02:43,826 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:43,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-09-17 20:02:43,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-17 20:02:43,906 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-17 20:02:43,906 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:43,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:43,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:43,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-17 20:02:43,911 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980963910"}]},"ts":"1694980963910"} 2023-09-17 20:02:43,912 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-17 20:02:43,913 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-17 20:02:43,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a5d3dcae68bdc336fd967482845cb558, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c96fc4af86c2538ce8581d298ab81211, UNASSIGN}] 2023-09-17 20:02:43,916 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a5d3dcae68bdc336fd967482845cb558, UNASSIGN 2023-09-17 20:02:43,916 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c96fc4af86c2538ce8581d298ab81211, UNASSIGN 2023-09-17 20:02:43,916 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a5d3dcae68bdc336fd967482845cb558, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:43,917 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c96fc4af86c2538ce8581d298ab81211, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:43,917 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980963916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980963916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980963916"}]},"ts":"1694980963916"} 2023-09-17 20:02:43,917 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980963917"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980963917"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980963917"}]},"ts":"1694980963917"} 2023-09-17 20:02:43,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure a5d3dcae68bdc336fd967482845cb558, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:02:43,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure c96fc4af86c2538ce8581d298ab81211, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:02:44,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-17 20:02:44,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:44,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a5d3dcae68bdc336fd967482845cb558, disabling compactions & flushes 2023-09-17 20:02:44,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:44,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:44,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. after waiting 0 ms 2023-09-17 20:02:44,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:44,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:44,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c96fc4af86c2538ce8581d298ab81211, disabling compactions & flushes 2023-09-17 20:02:44,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:44,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:44,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. after waiting 0 ms 2023-09-17 20:02:44,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:44,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:02:44,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:02:44,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:02:44,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:02:44,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211. 2023-09-17 20:02:44,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558. 2023-09-17 20:02:44,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c96fc4af86c2538ce8581d298ab81211: 2023-09-17 20:02:44,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a5d3dcae68bdc336fd967482845cb558: 2023-09-17 20:02:44,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:44,086 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a5d3dcae68bdc336fd967482845cb558, regionState=CLOSED 2023-09-17 20:02:44,087 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980964086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980964086"}]},"ts":"1694980964086"} 2023-09-17 20:02:44,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:44,087 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c96fc4af86c2538ce8581d298ab81211, regionState=CLOSED 2023-09-17 20:02:44,087 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694980964087"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980964087"}]},"ts":"1694980964087"} 2023-09-17 20:02:44,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-17 20:02:44,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure a5d3dcae68bdc336fd967482845cb558, server=jenkins-hbase4.apache.org,35419,1694980876302 in 170 msec 2023-09-17 20:02:44,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-17 20:02:44,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure c96fc4af86c2538ce8581d298ab81211, server=jenkins-hbase4.apache.org,41855,1694980876397 in 170 msec 2023-09-17 20:02:44,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a5d3dcae68bdc336fd967482845cb558, UNASSIGN in 175 msec 2023-09-17 20:02:44,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-17 20:02:44,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c96fc4af86c2538ce8581d298ab81211, UNASSIGN in 176 msec 2023-09-17 20:02:44,092 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980964092"}]},"ts":"1694980964092"} 2023-09-17 20:02:44,093 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-17 20:02:44,096 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-17 20:02:44,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-09-17 20:02:44,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-17 20:02:44,212 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-17 20:02:44,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,216 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,217 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,218 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,220 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,220 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,220 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,220 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-17 20:02:44,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-17 20:02:44,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-17 20:02:44,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-17 20:02:44,221 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:44,221 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:44,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:44,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:44,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:44,222 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:44,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-17 20:02:44,223 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/recovered.edits] 2023-09-17 20:02:44,223 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/recovered.edits] 2023-09-17 20:02:44,227 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/cf/b1b751925aec4bd3a7019387522d2b30 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/cf/b1b751925aec4bd3a7019387522d2b30 2023-09-17 20:02:44,228 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/cf/f95574d7804045019458f56258e9c9da to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/cf/f95574d7804045019458f56258e9c9da 2023-09-17 20:02:44,230 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558/recovered.edits/9.seqid 2023-09-17 20:02:44,230 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211/recovered.edits/9.seqid 2023-09-17 20:02:44,231 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a5d3dcae68bdc336fd967482845cb558 2023-09-17 20:02:44,231 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c96fc4af86c2538ce8581d298ab81211 2023-09-17 20:02:44,231 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-17 20:02:44,231 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-17 20:02:44,232 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-17 20:02:44,235 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917365650ae772648fead9d3ead2294f59e to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230917365650ae772648fead9d3ead2294f59e 2023-09-17 20:02:44,237 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917ae371a3fc58e4e30917e8030c71cb5ed to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230917ae371a3fc58e4e30917e8030c71cb5ed 2023-09-17 20:02:44,237 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-17 20:02:44,239 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,241 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-17 20:02:44,242 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-17 20:02:44,243 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,243 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-17 20:02:44,243 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980964243"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:44,243 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980964243"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:44,245 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 20:02:44,245 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a5d3dcae68bdc336fd967482845cb558, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694980948860.a5d3dcae68bdc336fd967482845cb558.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c96fc4af86c2538ce8581d298ab81211, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694980948860.c96fc4af86c2538ce8581d298ab81211.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 20:02:44,245 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-17 20:02:44,245 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694980964245"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:44,247 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-17 20:02:44,250 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-09-17 20:02:44,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-17 20:02:44,324 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-17 20:02:44,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-17 20:02:44,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-17 20:02:44,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-17 20:02:44,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-17 20:02:44,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-17 20:02:44,363 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 746) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:34526 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1961728240_1 at /127.0.0.1:57426 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4075 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:57436 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:43877 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:60724 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1961728240_1 at /127.0.0.1:60680 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=130 (was 154), ProcessCount=168 (was 168), AvailableMemoryMB=9055 (was 9120) 2023-09-17 20:02:44,363 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-17 20:02:44,382 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=130, ProcessCount=168, AvailableMemoryMB=9055 2023-09-17 20:02:44,382 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-17 20:02:44,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 20:02:44,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 20:02:44,386 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 20:02:44,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-17 20:02:44,387 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 20:02:44,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-17 20:02:44,389 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:44,389 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:44,390 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4 empty. 2023-09-17 20:02:44,390 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638 empty. 2023-09-17 20:02:44,390 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:44,390 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:44,390 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-17 20:02:44,399 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-17 20:02:44,400 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3da0ffcc716a8ab9bd636e1c5e971638, NAME => 'testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:02:44,400 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0fc33c91642d8473ca085b0d7654dfe4, NAME => 'testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0fc33c91642d8473ca085b0d7654dfe4, disabling compactions & flushes 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 3da0ffcc716a8ab9bd636e1c5e971638, disabling compactions & flushes 2023-09-17 20:02:44,412 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:44,412 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. after waiting 0 ms 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. after waiting 0 ms 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:44,412 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:44,412 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 3da0ffcc716a8ab9bd636e1c5e971638: 2023-09-17 20:02:44,412 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0fc33c91642d8473ca085b0d7654dfe4: 2023-09-17 20:02:44,415 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 20:02:44,415 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980964415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980964415"}]},"ts":"1694980964415"} 2023-09-17 20:02:44,415 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980964415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980964415"}]},"ts":"1694980964415"} 2023-09-17 20:02:44,417 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 20:02:44,418 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 20:02:44,418 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980964418"}]},"ts":"1694980964418"} 2023-09-17 20:02:44,419 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-17 20:02:44,422 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:02:44,423 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:02:44,423 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:02:44,423 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:02:44,423 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:02:44,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0fc33c91642d8473ca085b0d7654dfe4, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3da0ffcc716a8ab9bd636e1c5e971638, ASSIGN}] 2023-09-17 20:02:44,426 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0fc33c91642d8473ca085b0d7654dfe4, ASSIGN 2023-09-17 20:02:44,426 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3da0ffcc716a8ab9bd636e1c5e971638, ASSIGN 2023-09-17 20:02:44,426 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0fc33c91642d8473ca085b0d7654dfe4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41855,1694980876397; forceNewPlan=false, retain=false 2023-09-17 20:02:44,426 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3da0ffcc716a8ab9bd636e1c5e971638, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35419,1694980876302; forceNewPlan=false, retain=false 2023-09-17 20:02:44,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-17 20:02:44,577 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 20:02:44,579 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=3da0ffcc716a8ab9bd636e1c5e971638, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:44,579 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0fc33c91642d8473ca085b0d7654dfe4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:44,579 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980964579"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980964579"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980964579"}]},"ts":"1694980964579"} 2023-09-17 20:02:44,580 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980964579"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980964579"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980964579"}]},"ts":"1694980964579"} 2023-09-17 20:02:44,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 3da0ffcc716a8ab9bd636e1c5e971638, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:02:44,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 0fc33c91642d8473ca085b0d7654dfe4, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:02:44,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-17 20:02:44,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:44,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3da0ffcc716a8ab9bd636e1c5e971638, NAME => 'testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 20:02:44,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. service=AccessControlService 2023-09-17 20:02:44,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:44,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:02:44,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0fc33c91642d8473ca085b0d7654dfe4, NAME => 'testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 20:02:44,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:44,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. service=AccessControlService 2023-09-17 20:02:44,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:44,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:02:44,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:44,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:44,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:44,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:44,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:44,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:44,738 INFO [StoreOpener-0fc33c91642d8473ca085b0d7654dfe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:44,738 INFO [StoreOpener-3da0ffcc716a8ab9bd636e1c5e971638-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:44,739 DEBUG [StoreOpener-0fc33c91642d8473ca085b0d7654dfe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/cf 2023-09-17 20:02:44,740 DEBUG [StoreOpener-0fc33c91642d8473ca085b0d7654dfe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/cf 2023-09-17 20:02:44,739 DEBUG [StoreOpener-3da0ffcc716a8ab9bd636e1c5e971638-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/cf 2023-09-17 20:02:44,740 DEBUG [StoreOpener-3da0ffcc716a8ab9bd636e1c5e971638-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/cf 2023-09-17 20:02:44,740 INFO [StoreOpener-0fc33c91642d8473ca085b0d7654dfe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0fc33c91642d8473ca085b0d7654dfe4 columnFamilyName cf 2023-09-17 20:02:44,740 INFO [StoreOpener-3da0ffcc716a8ab9bd636e1c5e971638-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3da0ffcc716a8ab9bd636e1c5e971638 columnFamilyName cf 2023-09-17 20:02:44,742 INFO [StoreOpener-0fc33c91642d8473ca085b0d7654dfe4-1] regionserver.HStore(310): Store=0fc33c91642d8473ca085b0d7654dfe4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:02:44,742 INFO [StoreOpener-3da0ffcc716a8ab9bd636e1c5e971638-1] regionserver.HStore(310): Store=3da0ffcc716a8ab9bd636e1c5e971638/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:02:44,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:44,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:44,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:44,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:44,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:44,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:44,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:02:44,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:02:44,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0fc33c91642d8473ca085b0d7654dfe4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59400665, jitterRate=-0.11486111581325531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:02:44,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0fc33c91642d8473ca085b0d7654dfe4: 2023-09-17 20:02:44,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3da0ffcc716a8ab9bd636e1c5e971638; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74315239, jitterRate=0.1073833554983139}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:02:44,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3da0ffcc716a8ab9bd636e1c5e971638: 2023-09-17 20:02:44,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4., pid=94, masterSystemTime=1694980964733 2023-09-17 20:02:44,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638., pid=93, masterSystemTime=1694980964733 2023-09-17 20:02:44,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:44,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:44,751 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0fc33c91642d8473ca085b0d7654dfe4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:44,752 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980964751"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980964751"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980964751"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980964751"}]},"ts":"1694980964751"} 2023-09-17 20:02:44,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:44,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:44,752 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=3da0ffcc716a8ab9bd636e1c5e971638, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:44,752 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980964752"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980964752"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980964752"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980964752"}]},"ts":"1694980964752"} 2023-09-17 20:02:44,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-17 20:02:44,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 0fc33c91642d8473ca085b0d7654dfe4, server=jenkins-hbase4.apache.org,41855,1694980876397 in 171 msec 2023-09-17 20:02:44,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-17 20:02:44,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 3da0ffcc716a8ab9bd636e1c5e971638, server=jenkins-hbase4.apache.org,35419,1694980876302 in 173 msec 2023-09-17 20:02:44,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0fc33c91642d8473ca085b0d7654dfe4, ASSIGN in 332 msec 2023-09-17 20:02:44,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-17 20:02:44,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3da0ffcc716a8ab9bd636e1c5e971638, ASSIGN in 333 msec 2023-09-17 20:02:44,758 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 20:02:44,758 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980964758"}]},"ts":"1694980964758"} 2023-09-17 20:02:44,759 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-17 20:02:44,761 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 20:02:44,761 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-17 20:02:44,762 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 20:02:44,765 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:44,766 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:44,766 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:44,766 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:44,767 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:44,767 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:44,767 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:44,767 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:44,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 383 msec 2023-09-17 20:02:44,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-17 20:02:44,991 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-17 20:02:44,993 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-17 20:02:44,993 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:44,995 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:02:45,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:02:45,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980965005 (current time:1694980965005). 2023-09-17 20:02:45,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:02:45,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x496312bf to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:45,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@229da878, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:45,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:45,018 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:45,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x496312bf to 127.0.0.1:62829 2023-09-17 20:02:45,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:45,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x5360c9a9 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:45,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@247df90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:45,028 DEBUG [hconnection-0x4dd679c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:45,029 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:45,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:45,035 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:45,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5360c9a9 to 127.0.0.1:62829 2023-09-17 20:02:45,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:45,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 20:02:45,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:02:45,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:02:45,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:02:45,039 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:02:45,040 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694981565040 2023-09-17 20:02:45,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-17 20:02:45,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:02:45,041 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:02:45,041 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:02:45,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 20:02:45,042 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:02:45,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-17 20:02:45,046 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 20:02:45,047 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694981565047 2023-09-17 20:02:45,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,055 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-17 20:02:45,055 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:45,056 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-17 20:02:45,056 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-17 20:02:45,057 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,057 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,062 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,062 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,062 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,062 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,063 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,063 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,063 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,063 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:02:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-17 20:02:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 20:02:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:45,065 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 20:02:45,065 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 20:02:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 20:02:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 20:02:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 20:02:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 20:02:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 20:02:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 20:02:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 20:02:45,068 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 20:02:45,069 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,069 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,069 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,070 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,070 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-17 20:02:45,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15af7bf0[Count = 1] remaining members to acquire global barrier 2023-09-17 20:02:45,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-17 20:02:45,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15af7bf0[Count = 0] remaining members to acquire global barrier 2023-09-17 20:02:45,077 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-17 20:02:45,077 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,079 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,079 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,079 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,080 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:02:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 20:02:45,080 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:02:45,080 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:45,080 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:02:45,080 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. started... 2023-09-17 20:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:45,080 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:45,080 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. started... 2023-09-17 20:02:45,080 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0fc33c91642d8473ca085b0d7654dfe4: 2023-09-17 20:02:45,082 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3da0ffcc716a8ab9bd636e1c5e971638: 2023-09-17 20:02:45,082 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,082 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:45,082 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,082 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:02:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 20:02:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:45,082 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 20:02:45,083 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:02:45,090 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. completed. 2023-09-17 20:02:45,090 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. completed. 2023-09-17 20:02:45,090 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:45,090 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:02:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:02:45,092 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 20:02:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:45,093 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 20:02:45,094 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 20:02:45,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 20:02:45,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:02:45,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-17 20:02:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:02:45,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-17 20:02:45,100 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-17 20:02:45,100 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:02:45,100 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:02:45,100 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,100 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:02:45,103 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,103 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,103 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,103 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,103 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,103 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,103 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,104 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,105 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,107 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,108 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,108 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,109 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,111 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,111 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,111 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,111 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,111 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,111 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,111 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,111 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-17 20:02:45,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,111 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:45,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,111 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,112 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:02:45,113 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,113 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,113 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,113 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,113 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,113 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,113 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 20:02:45,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,154 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:45,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 20:02:45,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:02:45,155 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:02:45,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-17 20:02:45,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,161 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694980965040Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694980965120 (+80 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694980965120Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694980965120Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694980965124 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694980965131 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694980965161 (+30 ms) 2023-09-17 20:02:45,164 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 20:02:45,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 123 msec 2023-09-17 20:02:45,355 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:45,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 20:02:45,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:02:45,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41855] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:02:45,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35419] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:02:45,362 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-17 20:02:45,362 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:45,362 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:02:45,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:02:45,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980965371 (current time:1694980965371). 2023-09-17 20:02:45,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:02:45,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x25a07495 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:45,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bc641d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:45,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:45,380 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:45,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25a07495 to 127.0.0.1:62829 2023-09-17 20:02:45,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:45,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x4b033fe5 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:45,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6da1eecc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:45,390 DEBUG [hconnection-0x480fa69-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:45,392 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:45,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:45,396 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:45,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b033fe5 to 127.0.0.1:62829 2023-09-17 20:02:45,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:45,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-17 20:02:45,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:02:45,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:02:45,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:02:45,400 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:02:45,401 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694981565401 2023-09-17 20:02:45,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-17 20:02:45,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-17 20:02:45,402 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:02:45,402 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:02:45,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 20:02:45,403 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-17 20:02:45,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-17 20:02:45,405 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 20:02:45,406 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694981565406 2023-09-17 20:02:45,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,413 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-17 20:02:45,413 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:45,414 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-17 20:02:45,414 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-17 20:02:45,414 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,414 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,416 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,416 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,416 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,416 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,416 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,416 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,416 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,417 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-17 20:02:45,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,418 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 20:02:45,418 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:45,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,419 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 20:02:45,419 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 20:02:45,419 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:45,419 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-17 20:02:45,419 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:45,419 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 20:02:45,423 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 20:02:45,423 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 20:02:45,423 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 20:02:45,420 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-17 20:02:45,423 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-17 20:02:45,423 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 20:02:45,423 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-17 20:02:45,424 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,426 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,426 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,426 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,426 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,426 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,426 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,426 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:45,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,426 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:45,426 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,426 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:45,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-17 20:02:45,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24ede5e6[Count = 1] remaining members to acquire global barrier 2023-09-17 20:02:45,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-17 20:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24ede5e6[Count = 0] remaining members to acquire global barrier 2023-09-17 20:02:45,430 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-17 20:02:45,430 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:02:45,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 20:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-17 20:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:45,434 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,435 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:45,435 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:45,435 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:02:45,434 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:45,435 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. started... 2023-09-17 20:02:45,435 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. started... 2023-09-17 20:02:45,435 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:02:45,435 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0fc33c91642d8473ca085b0d7654dfe4 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-17 20:02:45,435 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3da0ffcc716a8ab9bd636e1c5e971638 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-17 20:02:45,436 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 20:02:45,436 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:45,436 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 20:02:45,452 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917da194a7b36ae446faf6fa61637adfad3 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230917da194a7b36ae446faf6fa61637adfad3 2023-09-17 20:02:45,454 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230917dc0d670b58c24bd2ac44af2fe0f610d8 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230917dc0d670b58c24bd2ac44af2fe0f610d8 2023-09-17 20:02:45,462 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/.tmp/cf/a8b9317ec20147b78ded18095493bd7e 2023-09-17 20:02:45,465 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/.tmp/cf/bf0206ab0a8043db8a96280fda0ae045 2023-09-17 20:02:45,467 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/.tmp/cf/a8b9317ec20147b78ded18095493bd7e as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/cf/a8b9317ec20147b78ded18095493bd7e 2023-09-17 20:02:45,470 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/.tmp/cf/bf0206ab0a8043db8a96280fda0ae045 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/cf/bf0206ab0a8043db8a96280fda0ae045 2023-09-17 20:02:45,473 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/cf/a8b9317ec20147b78ded18095493bd7e, entries=6, sequenceid=6, filesize=5.9 K 2023-09-17 20:02:45,474 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 0fc33c91642d8473ca085b0d7654dfe4 in 39ms, sequenceid=6, compaction requested=false 2023-09-17 20:02:45,474 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-17 20:02:45,474 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0fc33c91642d8473ca085b0d7654dfe4: 2023-09-17 20:02:45,475 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,476 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:45,476 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/cf/a8b9317ec20147b78ded18095493bd7e] hfiles 2023-09-17 20:02:45,476 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/cf/a8b9317ec20147b78ded18095493bd7e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,477 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/cf/bf0206ab0a8043db8a96280fda0ae045, entries=44, sequenceid=6, filesize=12.6 K 2023-09-17 20:02:45,478 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 3da0ffcc716a8ab9bd636e1c5e971638 in 43ms, sequenceid=6, compaction requested=false 2023-09-17 20:02:45,479 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3da0ffcc716a8ab9bd636e1c5e971638: 2023-09-17 20:02:45,479 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,479 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:45,480 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/cf/bf0206ab0a8043db8a96280fda0ae045] hfiles 2023-09-17 20:02:45,480 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/cf/bf0206ab0a8043db8a96280fda0ae045 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,486 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. completed. 2023-09-17 20:02:45,487 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 20:02:45,487 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:02:45,488 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. completed. 2023-09-17 20:02:45,488 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:45,488 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:45,488 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:45,488 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,488 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-17 20:02:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:02:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 20:02:45,489 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 20:02:45,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,491 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,491 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-17 20:02:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-17 20:02:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:02:45,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-17 20:02:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:02:45,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-17 20:02:45,499 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-17 20:02:45,499 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:02:45,499 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:02:45,499 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,499 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:02:45,500 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,500 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,500 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,500 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,500 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,500 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:45,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,501 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,501 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:45,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,501 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,502 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,502 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,503 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 20:02:45,503 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:45,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:02:45,504 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,504 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:02:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,506 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:45,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:45,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,506 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:45,508 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,508 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:45,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:02:45,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,508 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:45,508 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:45,508 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:45,508 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,508 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230917dc0d670b58c24bd2ac44af2fe0f610d8, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230917da194a7b36ae446faf6fa61637adfad3] mob files 2023-09-17 20:02:45,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230917dc0d670b58c24bd2ac44af2fe0f610d8 2023-09-17 20:02:45,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230917da194a7b36ae446faf6fa61637adfad3 2023-09-17 20:02:45,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-17 20:02:45,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,531 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694980965401Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694980965515 (+114 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694980965515Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694980965515Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694980965518 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694980965524 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694980965530 (+6 ms) 2023-09-17 20:02:45,535 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-17 20:02:45,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 133 msec 2023-09-17 20:02:45,704 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:45,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-17 20:02:45,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:02:45,705 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705 2023-09-17 20:02:45,705 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36291, tgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705, rawTgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705, srcFsUri=hdfs://localhost:36291, srcDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:02:45,727 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:02:45,727 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1441402650_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,728 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c, snapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-17 20:02:45,733 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:45,754 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:45,754 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:45,755 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:45,755 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:46,622 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-485591945568855355.jar 2023-09-17 20:02:46,623 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:46,623 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:46,689 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-2033499344902107218.jar 2023-09-17 20:02:46,689 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:46,690 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:46,690 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:46,690 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:46,691 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:46,691 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:46,691 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 20:02:46,692 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 20:02:46,692 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 20:02:46,692 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 20:02:46,693 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 20:02:46,693 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 20:02:46,694 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 20:02:46,694 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 20:02:46,694 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 20:02:46,695 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 20:02:46,695 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:46,695 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:46,696 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:46,696 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:46,696 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:46,697 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:46,697 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:47,047 WARN [Listener at jenkins-hbase4.apache.org/39363] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 20:02:47,049 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-17 20:02:48,038 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:48,038 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:48,040 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0005_000001 (auth:SIMPLE) 2023-09-17 20:02:48,546 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0006_000001 (auth:SIMPLE) 2023-09-17 20:02:49,247 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 20:02:52,213 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0006_000001 (auth:SIMPLE) 2023-09-17 20:02:54,402 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 20:02:54,403 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 20:02:54,408 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:54,408 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 20:02:54,408 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 20:02:54,408 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:54,409 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-17 20:02:54,409 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-17 20:02:54,409 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:54,410 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-17 20:02:54,410 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980965705/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-17 20:02:54,414 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-17 20:02:54,418 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980974418"}]},"ts":"1694980974418"} 2023-09-17 20:02:54,419 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-17 20:02:54,421 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-17 20:02:54,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0fc33c91642d8473ca085b0d7654dfe4, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3da0ffcc716a8ab9bd636e1c5e971638, UNASSIGN}] 2023-09-17 20:02:54,423 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0fc33c91642d8473ca085b0d7654dfe4, UNASSIGN 2023-09-17 20:02:54,423 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3da0ffcc716a8ab9bd636e1c5e971638, UNASSIGN 2023-09-17 20:02:54,424 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0fc33c91642d8473ca085b0d7654dfe4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:54,424 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=3da0ffcc716a8ab9bd636e1c5e971638, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:54,424 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980974424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980974424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980974424"}]},"ts":"1694980974424"} 2023-09-17 20:02:54,424 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980974424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980974424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980974424"}]},"ts":"1694980974424"} 2023-09-17 20:02:54,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 0fc33c91642d8473ca085b0d7654dfe4, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:02:54,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 3da0ffcc716a8ab9bd636e1c5e971638, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:02:54,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-17 20:02:54,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:54,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:54,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0fc33c91642d8473ca085b0d7654dfe4, disabling compactions & flushes 2023-09-17 20:02:54,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3da0ffcc716a8ab9bd636e1c5e971638, disabling compactions & flushes 2023-09-17 20:02:54,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:54,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:54,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:54,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:54,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. after waiting 0 ms 2023-09-17 20:02:54,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:54,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. after waiting 0 ms 2023-09-17 20:02:54,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:54,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:02:54,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:02:54,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:02:54,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:02:54,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4. 2023-09-17 20:02:54,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0fc33c91642d8473ca085b0d7654dfe4: 2023-09-17 20:02:54,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638. 2023-09-17 20:02:54,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3da0ffcc716a8ab9bd636e1c5e971638: 2023-09-17 20:02:54,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:54,590 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=3da0ffcc716a8ab9bd636e1c5e971638, regionState=CLOSED 2023-09-17 20:02:54,590 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980974590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980974590"}]},"ts":"1694980974590"} 2023-09-17 20:02:54,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:54,591 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0fc33c91642d8473ca085b0d7654dfe4, regionState=CLOSED 2023-09-17 20:02:54,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694980974591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980974591"}]},"ts":"1694980974591"} 2023-09-17 20:02:54,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-17 20:02:54,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 3da0ffcc716a8ab9bd636e1c5e971638, server=jenkins-hbase4.apache.org,35419,1694980876302 in 165 msec 2023-09-17 20:02:54,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-17 20:02:54,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 0fc33c91642d8473ca085b0d7654dfe4, server=jenkins-hbase4.apache.org,41855,1694980876397 in 167 msec 2023-09-17 20:02:54,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3da0ffcc716a8ab9bd636e1c5e971638, UNASSIGN in 172 msec 2023-09-17 20:02:54,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-17 20:02:54,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0fc33c91642d8473ca085b0d7654dfe4, UNASSIGN in 172 msec 2023-09-17 20:02:54,595 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980974595"}]},"ts":"1694980974595"} 2023-09-17 20:02:54,596 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-17 20:02:54,598 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-17 20:02:54,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 185 msec 2023-09-17 20:02:54,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-17 20:02:54,720 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-17 20:02:54,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,723 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,724 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,725 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,728 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:54,728 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:54,728 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,728 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,728 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,728 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,729 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-17 20:02:54,729 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-17 20:02:54,729 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-17 20:02:54,729 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-17 20:02:54,730 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,730 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,730 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,730 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:54,730 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,730 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:54,730 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:54,730 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:54,730 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/recovered.edits] 2023-09-17 20:02:54,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-17 20:02:54,730 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/recovered.edits] 2023-09-17 20:02:54,734 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/cf/a8b9317ec20147b78ded18095493bd7e to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/cf/a8b9317ec20147b78ded18095493bd7e 2023-09-17 20:02:54,734 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/cf/bf0206ab0a8043db8a96280fda0ae045 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/cf/bf0206ab0a8043db8a96280fda0ae045 2023-09-17 20:02:54,736 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638/recovered.edits/9.seqid 2023-09-17 20:02:54,736 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4/recovered.edits/9.seqid 2023-09-17 20:02:54,737 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/3da0ffcc716a8ab9bd636e1c5e971638 2023-09-17 20:02:54,737 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testEmptyExportFileSystemState/0fc33c91642d8473ca085b0d7654dfe4 2023-09-17 20:02:54,737 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-17 20:02:54,737 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-17 20:02:54,738 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-17 20:02:54,741 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230917dc0d670b58c24bd2ac44af2fe0f610d8 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230917dc0d670b58c24bd2ac44af2fe0f610d8 2023-09-17 20:02:54,742 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230917da194a7b36ae446faf6fa61637adfad3 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230917da194a7b36ae446faf6fa61637adfad3 2023-09-17 20:02:54,742 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-17 20:02:54,744 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,746 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-17 20:02:54,748 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-17 20:02:54,749 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,749 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-17 20:02:54,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980974749"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:54,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980974749"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:54,750 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 20:02:54,751 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0fc33c91642d8473ca085b0d7654dfe4, NAME => 'testtb-testEmptyExportFileSystemState,,1694980964383.0fc33c91642d8473ca085b0d7654dfe4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3da0ffcc716a8ab9bd636e1c5e971638, NAME => 'testtb-testEmptyExportFileSystemState,1,1694980964383.3da0ffcc716a8ab9bd636e1c5e971638.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 20:02:54,751 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-17 20:02:54,751 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694980974751"}]},"ts":"9223372036854775807"} 2023-09-17 20:02:54,752 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-17 20:02:54,755 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-17 20:02:54,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-09-17 20:02:54,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-17 20:02:54,832 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-17 20:02:54,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-17 20:02:54,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:54,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-17 20:02:54,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-17 20:02:54,867 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 760) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4727 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:45739 from appattempt_1694980882764_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:40030 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-766717962_1 at /127.0.0.1:46020 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-766717962_1 at /127.0.0.1:36858 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:36243 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:36922 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-609269198_17 at /127.0.0.1:46054 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:46513 from appattempt_1694980882764_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18c5862a-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=943 (was 914) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=147 (was 130) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=8982 (was 9055) 2023-09-17 20:02:54,867 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-17 20:02:54,887 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=943, MaxFileDescriptor=60000, SystemLoadAverage=147, ProcessCount=168, AvailableMemoryMB=8981 2023-09-17 20:02:54,887 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-17 20:02:54,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-17 20:02:54,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:54,891 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-17 20:02:54,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-17 20:02:54,892 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-17 20:02:54,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-17 20:02:54,894 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4 2023-09-17 20:02:54,894 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:02:54,895 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4 empty. 2023-09-17 20:02:54,895 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515 empty. 2023-09-17 20:02:54,895 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4 2023-09-17 20:02:54,895 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:02:54,895 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-17 20:02:54,905 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-17 20:02:54,906 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => cefccc0050681b34927a992947920cb4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:02:54,906 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4067cd1004e13b957c56db8ebfad6515, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp 2023-09-17 20:02:54,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:54,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing cefccc0050681b34927a992947920cb4, disabling compactions & flushes 2023-09-17 20:02:54,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:54,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:54,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. after waiting 0 ms 2023-09-17 20:02:54,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:54,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:54,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for cefccc0050681b34927a992947920cb4: 2023-09-17 20:02:54,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:54,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 4067cd1004e13b957c56db8ebfad6515, disabling compactions & flushes 2023-09-17 20:02:54,923 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:54,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:54,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. after waiting 0 ms 2023-09-17 20:02:54,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:54,923 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:54,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 4067cd1004e13b957c56db8ebfad6515: 2023-09-17 20:02:54,925 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-17 20:02:54,926 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980974925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980974925"}]},"ts":"1694980974925"} 2023-09-17 20:02:54,926 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980974925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980974925"}]},"ts":"1694980974925"} 2023-09-17 20:02:54,927 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-17 20:02:54,928 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-17 20:02:54,928 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980974928"}]},"ts":"1694980974928"} 2023-09-17 20:02:54,929 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-17 20:02:54,932 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-17 20:02:54,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-17 20:02:54,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-17 20:02:54,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-17 20:02:54,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-17 20:02:54,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cefccc0050681b34927a992947920cb4, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4067cd1004e13b957c56db8ebfad6515, ASSIGN}] 2023-09-17 20:02:54,936 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cefccc0050681b34927a992947920cb4, ASSIGN 2023-09-17 20:02:54,936 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4067cd1004e13b957c56db8ebfad6515, ASSIGN 2023-09-17 20:02:54,937 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cefccc0050681b34927a992947920cb4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35419,1694980876302; forceNewPlan=false, retain=false 2023-09-17 20:02:54,937 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4067cd1004e13b957c56db8ebfad6515, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41855,1694980876397; forceNewPlan=false, retain=false 2023-09-17 20:02:54,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-17 20:02:55,087 INFO [jenkins-hbase4:46221] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-17 20:02:55,090 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4067cd1004e13b957c56db8ebfad6515, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,090 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cefccc0050681b34927a992947920cb4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,090 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980975090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980975090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980975090"}]},"ts":"1694980975090"} 2023-09-17 20:02:55,090 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980975090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980975090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980975090"}]},"ts":"1694980975090"} 2023-09-17 20:02:55,091 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 4067cd1004e13b957c56db8ebfad6515, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:02:55,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure cefccc0050681b34927a992947920cb4, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:02:55,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-17 20:02:55,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:55,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:55,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cefccc0050681b34927a992947920cb4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.', STARTKEY => '', ENDKEY => '1'} 2023-09-17 20:02:55,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4067cd1004e13b957c56db8ebfad6515, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.', STARTKEY => '1', ENDKEY => ''} 2023-09-17 20:02:55,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. service=AccessControlService 2023-09-17 20:02:55,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. service=AccessControlService 2023-09-17 20:02:55,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:02:55,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-17 20:02:55,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp cefccc0050681b34927a992947920cb4 2023-09-17 20:02:55,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:02:55,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:55,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-17 20:02:55,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cefccc0050681b34927a992947920cb4 2023-09-17 20:02:55,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:02:55,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:02:55,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cefccc0050681b34927a992947920cb4 2023-09-17 20:02:55,248 INFO [StoreOpener-cefccc0050681b34927a992947920cb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cefccc0050681b34927a992947920cb4 2023-09-17 20:02:55,248 INFO [StoreOpener-4067cd1004e13b957c56db8ebfad6515-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:02:55,249 DEBUG [StoreOpener-cefccc0050681b34927a992947920cb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/cf 2023-09-17 20:02:55,249 DEBUG [StoreOpener-cefccc0050681b34927a992947920cb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/cf 2023-09-17 20:02:55,249 DEBUG [StoreOpener-4067cd1004e13b957c56db8ebfad6515-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/cf 2023-09-17 20:02:55,249 DEBUG [StoreOpener-4067cd1004e13b957c56db8ebfad6515-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/cf 2023-09-17 20:02:55,249 INFO [StoreOpener-cefccc0050681b34927a992947920cb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cefccc0050681b34927a992947920cb4 columnFamilyName cf 2023-09-17 20:02:55,249 INFO [StoreOpener-4067cd1004e13b957c56db8ebfad6515-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4067cd1004e13b957c56db8ebfad6515 columnFamilyName cf 2023-09-17 20:02:55,251 INFO [StoreOpener-cefccc0050681b34927a992947920cb4-1] regionserver.HStore(310): Store=cefccc0050681b34927a992947920cb4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:02:55,251 INFO [StoreOpener-4067cd1004e13b957c56db8ebfad6515-1] regionserver.HStore(310): Store=4067cd1004e13b957c56db8ebfad6515/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-17 20:02:55,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4 2023-09-17 20:02:55,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:02:55,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4 2023-09-17 20:02:55,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:02:55,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cefccc0050681b34927a992947920cb4 2023-09-17 20:02:55,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:02:55,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:02:55,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-17 20:02:55,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cefccc0050681b34927a992947920cb4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64656863, jitterRate=-0.03653766214847565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:02:55,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cefccc0050681b34927a992947920cb4: 2023-09-17 20:02:55,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4067cd1004e13b957c56db8ebfad6515; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75157142, jitterRate=0.11992868781089783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-17 20:02:55,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4067cd1004e13b957c56db8ebfad6515: 2023-09-17 20:02:55,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4., pid=109, masterSystemTime=1694980975243 2023-09-17 20:02:55,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515., pid=108, masterSystemTime=1694980975243 2023-09-17 20:02:55,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:55,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:55,258 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cefccc0050681b34927a992947920cb4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:55,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:55,259 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980975258"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980975258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980975258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980975258"}]},"ts":"1694980975258"} 2023-09-17 20:02:55,259 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4067cd1004e13b957c56db8ebfad6515, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,259 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980975259"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694980975259"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694980975259"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694980975259"}]},"ts":"1694980975259"} 2023-09-17 20:02:55,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-17 20:02:55,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure cefccc0050681b34927a992947920cb4, server=jenkins-hbase4.apache.org,35419,1694980876302 in 168 msec 2023-09-17 20:02:55,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-17 20:02:55,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 4067cd1004e13b957c56db8ebfad6515, server=jenkins-hbase4.apache.org,41855,1694980876397 in 170 msec 2023-09-17 20:02:55,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cefccc0050681b34927a992947920cb4, ASSIGN in 327 msec 2023-09-17 20:02:55,263 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-17 20:02:55,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4067cd1004e13b957c56db8ebfad6515, ASSIGN in 328 msec 2023-09-17 20:02:55,264 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-17 20:02:55,264 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980975264"}]},"ts":"1694980975264"} 2023-09-17 20:02:55,265 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-17 20:02:55,267 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-17 20:02:55,267 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-17 20:02:55,269 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-17 20:02:55,271 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:55,271 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:55,271 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:55,271 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:02:55,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:55,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:55,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:55,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-17 20:02:55,273 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 383 msec 2023-09-17 20:02:55,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-17 20:02:55,496 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-17 20:02:55,498 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,499 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:55,500 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:02:55,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 20:02:55,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980975510 (current time:1694980975510). 2023-09-17 20:02:55,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:02:55,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x555ab247 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:55,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17cd4254, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:55,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:55,522 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:55,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x555ab247 to 127.0.0.1:62829 2023-09-17 20:02:55,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:55,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x72126a48 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:55,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@725a26c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:55,530 DEBUG [hconnection-0xff8053a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:55,533 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:55,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:55,539 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:55,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72126a48 to 127.0.0.1:62829 2023-09-17 20:02:55,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:55,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-17 20:02:55,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:02:55,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 20:02:55,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 20:02:55,543 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 20:02:55,543 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694981575543 2023-09-17 20:02:55,544 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 20:02:55,545 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:02:55,545 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:02:55,546 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 20:02:55,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 20:02:55,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-17 20:02:55,547 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 20:02:55,548 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694981575548 2023-09-17 20:02:55,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,561 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-17 20:02:55,561 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:55,562 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-17 20:02:55,562 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-17 20:02:55,562 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,562 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,564 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,564 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,564 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,564 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,564 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,564 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,565 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,565 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 20:02:55,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,569 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 20:02:55,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,569 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:55,569 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 20:02:55,569 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:55,571 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 20:02:55,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,571 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 20:02:55,571 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 20:02:55,571 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 20:02:55,572 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 20:02:55,571 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 20:02:55,571 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:55,572 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 20:02:55,573 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 20:02:55,573 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 20:02:55,573 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 20:02:55,580 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,580 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,581 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,581 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,581 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:55,581 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,581 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,581 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,581 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:55,581 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,581 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:55,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-17 20:02:55,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cccabca[Count = 1] remaining members to acquire global barrier 2023-09-17 20:02:55,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-17 20:02:55,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cccabca[Count = 0] remaining members to acquire global barrier 2023-09-17 20:02:55,584 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-17 20:02:55,585 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 20:02:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,586 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 20:02:55,586 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,586 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:02:55,586 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:55,586 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:55,586 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:55,586 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:55,586 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 20:02:55,586 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 20:02:55,586 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. started... 2023-09-17 20:02:55,586 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:55,586 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:55,586 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. started... 2023-09-17 20:02:55,586 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:02:55,587 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cefccc0050681b34927a992947920cb4: 2023-09-17 20:02:55,588 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4067cd1004e13b957c56db8ebfad6515: 2023-09-17 20:02:55,588 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,588 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,588 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:55,588 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:55,588 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:02:55,588 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-17 20:02:55,590 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 20:02:55,590 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:55,590 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 20:02:55,606 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. completed. 2023-09-17 20:02:55,606 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:55,606 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. completed. 2023-09-17 20:02:55,607 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:55,606 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:55,607 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:55,607 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:55,607 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:55,607 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,607 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,607 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 20:02:55,607 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 20:02:55,607 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:02:55,607 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:02:55,608 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,608 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 20:02:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,608 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,608 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 20:02:55,608 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:55,609 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:55,609 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 20:02:55,610 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 20:02:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:02:55,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-17 20:02:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:02:55,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-17 20:02:55,619 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-17 20:02:55,619 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:02:55,619 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:02:55,619 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,619 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:02:55,621 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,621 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,621 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,622 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,621 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,622 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,623 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,626 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,626 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,627 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,629 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,629 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,629 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,629 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,629 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,629 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,629 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,630 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,629 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,631 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,630 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:02:55,631 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,632 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,632 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,632 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,632 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,632 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,632 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-17 20:02:55,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,646 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:55,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-17 20:02:55,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:02:55,647 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:02:55,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-17 20:02:55,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,667 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694980975544Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694980975640 (+96 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694980975640Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694980975640Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694980975644 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694980975661 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694980975667 (+6 ms) 2023-09-17 20:02:55,670 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 20:02:55,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 126 msec 2023-09-17 20:02:55,847 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:55,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-17 20:02:55,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:02:55,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35419] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:02:55,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41855] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. with WAL disabled. Data may be lost in the event of a crash. 2023-09-17 20:02:55,853 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,853 DEBUG [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:55,853 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-17 20:02:55,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 20:02:55,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694980975862 (current time:1694980975862). 2023-09-17 20:02:55,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-17 20:02:55,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x2dba3634 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:55,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6224376c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:55,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:55,874 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:55,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2dba3634 to 127.0.0.1:62829 2023-09-17 20:02:55,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:55,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(139): Connect 0x08d31402 to 127.0.0.1:62829 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-17 20:02:55,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@742498ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-17 20:02:55,885 DEBUG [hconnection-0x37f85e05-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:55,886 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:55,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-17 20:02:55,896 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-17 20:02:55,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08d31402 to 127.0.0.1:62829 2023-09-17 20:02:55,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:02:55,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-17 20:02:55,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-17 20:02:55,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 20:02:55,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 20:02:55,901 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 20:02:55,902 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694981575902 2023-09-17 20:02:55,902 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-17 20:02:55,903 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-17 20:02:55,903 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-17 20:02:55,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 20:02:55,904 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-17 20:02:55,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-17 20:02:55,905 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 20:02:55,906 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694981575906 2023-09-17 20:02:55,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,916 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-17 20:02:55,916 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:55,918 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-17 20:02:55,918 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-17 20:02:55,918 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,918 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,920 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,920 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,920 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,920 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,921 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,921 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,921 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,921 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 20:02:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-17 20:02:55,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-17 20:02:55,922 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 20:02:55,922 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:55,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,923 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,923 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 20:02:55,923 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 20:02:55,923 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:55,923 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 20:02:55,924 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 20:02:55,924 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 20:02:55,923 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-17 20:02:55,924 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45281,1694980876357' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 20:02:55,924 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 20:02:55,924 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-17 20:02:55,925 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-17 20:02:55,925 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-17 20:02:55,925 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-17 20:02:55,926 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,926 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,926 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,927 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,927 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,927 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,927 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:55,927 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,927 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:55,927 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,927 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-17 20:02:55,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41855,1694980876397' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-17 20:02:55,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f577073[Count = 1] remaining members to acquire global barrier 2023-09-17 20:02:55,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35419,1694980876302' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-17 20:02:55,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f577073[Count = 0] remaining members to acquire global barrier 2023-09-17 20:02:55,930 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-17 20:02:55,930 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,936 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,936 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,936 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 20:02:55,937 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,936 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 20:02:55,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 20:02:55,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45281,1694980876357' in zk 2023-09-17 20:02:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-17 20:02:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:55,937 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:55,937 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,937 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-17 20:02:55,937 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:55,937 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. started... 2023-09-17 20:02:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-17 20:02:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-17 20:02:55,937 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. started... 2023-09-17 20:02:55,937 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cefccc0050681b34927a992947920cb4 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-17 20:02:55,937 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4067cd1004e13b957c56db8ebfad6515 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-17 20:02:55,938 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 20:02:55,938 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:55,938 DEBUG [member: 'jenkins-hbase4.apache.org,45281,1694980876357' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 20:02:55,953 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230917eb5dc02622a94e4f9a0b1c423eb6f7bc to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917eb5dc02622a94e4f9a0b1c423eb6f7bc 2023-09-17 20:02:55,953 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230917274358bba1d54a56854f5a38795d8a67 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917274358bba1d54a56854f5a38795d8a67 2023-09-17 20:02:55,960 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/.tmp/cf/7460cebdc8ad4e57b4dfe480a5554227 2023-09-17 20:02:55,960 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/.tmp/cf/0a241e7c4b314b7bbca366fb5b1f0b7a 2023-09-17 20:02:55,964 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/.tmp/cf/7460cebdc8ad4e57b4dfe480a5554227 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/cf/7460cebdc8ad4e57b4dfe480a5554227 2023-09-17 20:02:55,964 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/.tmp/cf/0a241e7c4b314b7bbca366fb5b1f0b7a as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/cf/0a241e7c4b314b7bbca366fb5b1f0b7a 2023-09-17 20:02:55,968 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/cf/0a241e7c4b314b7bbca366fb5b1f0b7a, entries=44, sequenceid=6, filesize=12.8 K 2023-09-17 20:02:55,969 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/cf/7460cebdc8ad4e57b4dfe480a5554227, entries=6, sequenceid=6, filesize=6.0 K 2023-09-17 20:02:55,969 INFO [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 4067cd1004e13b957c56db8ebfad6515 in 32ms, sequenceid=6, compaction requested=false 2023-09-17 20:02:55,969 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-17 20:02:55,969 INFO [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for cefccc0050681b34927a992947920cb4 in 32ms, sequenceid=6, compaction requested=false 2023-09-17 20:02:55,969 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4067cd1004e13b957c56db8ebfad6515: 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cefccc0050681b34927a992947920cb4: 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/cf/0a241e7c4b314b7bbca366fb5b1f0b7a] hfiles 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/cf/7460cebdc8ad4e57b4dfe480a5554227] hfiles 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/cf/0a241e7c4b314b7bbca366fb5b1f0b7a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,972 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/cf/7460cebdc8ad4e57b4dfe480a5554227 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,980 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. completed. 2023-09-17 20:02:55,980 DEBUG [rs(jenkins-hbase4.apache.org,35419,1694980876302)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:02:55,980 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:55,980 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:55,980 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,980 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 20:02:55,980 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35419,1694980876302' in zk 2023-09-17 20:02:55,980 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. completed. 2023-09-17 20:02:55,980 DEBUG [rs(jenkins-hbase4.apache.org,41855,1694980876397)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:02:55,980 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-17 20:02:55,981 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-17 20:02:55,981 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,981 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-17 20:02:55,981 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41855,1694980876397' in zk 2023-09-17 20:02:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 20:02:55,982 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:55,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,982 DEBUG [member: 'jenkins-hbase4.apache.org,35419,1694980876302' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 20:02:55,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,984 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,984 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-17 20:02:55,984 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,984 DEBUG [member: 'jenkins-hbase4.apache.org,41855,1694980876397' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-17 20:02:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35419,1694980876302': 2023-09-17 20:02:55,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35419,1694980876302' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-17 20:02:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41855,1694980876397': 2023-09-17 20:02:55,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41855,1694980876397' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-17 20:02:55,990 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-17 20:02:55,990 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-17 20:02:55,990 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-17 20:02:55,990 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,990 INFO [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-17 20:02:55,992 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,992 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-17 20:02:55,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-17 20:02:55,992 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,993 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-17 20:02:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,993 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-17 20:02:55,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,995 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,995 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-17 20:02:55,995 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:55,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:55,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,998 DEBUG [(jenkins-hbase4.apache.org,46221,1694980874966)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-17 20:02:55,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:55,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-17 20:02:55,998 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-17 20:02:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-17 20:02:56,000 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:02:56,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-17 20:02:56,000 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,000 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:02:56,000 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:02:56,000 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,000 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-17 20:02:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-17 20:02:56,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917eb5dc02622a94e4f9a0b1c423eb6f7bc, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917274358bba1d54a56854f5a38795d8a67] mob files 2023-09-17 20:02:56,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917eb5dc02622a94e4f9a0b1c423eb6f7bc 2023-09-17 20:02:56,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917274358bba1d54a56854f5a38795d8a67 2023-09-17 20:02:56,003 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:56,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-17 20:02:56,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-17 20:02:56,004 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-17 20:02:56,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-17 20:02:56,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,027 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694980975902Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694980976007 (+105 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694980976007Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694980976007Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694980976010 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694980976019 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694980976026 (+7 ms) 2023-09-17 20:02:56,029 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-17 20:02:56,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 127 msec 2023-09-17 20:02:56,204 DEBUG [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-17 20:02:56,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-17 20:02:56,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-17 20:02:56,206 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206 2023-09-17 20:02:56,206 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36291, tgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206, rawTgtDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206, srcFsUri=hdfs://localhost:36291, srcDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:02:56,228 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c 2023-09-17 20:02:56,228 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-624074314_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,228 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36291, inputRoot=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c, snapshotDir=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-17 20:02:56,235 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:02:56,257 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:56,257 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:56,258 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:56,258 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:57,129 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-2432606139712618315.jar 2023-09-17 20:02:57,129 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:57,129 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:57,195 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/hadoop-2131635977630367434.jar 2023-09-17 20:02:57,196 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:57,196 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:57,196 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:57,197 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:57,197 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:57,197 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-17 20:02:57,198 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-17 20:02:57,198 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-17 20:02:57,198 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-17 20:02:57,199 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-17 20:02:57,199 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-17 20:02:57,199 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-17 20:02:57,200 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-17 20:02:57,200 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-17 20:02:57,200 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-17 20:02:57,201 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-17 20:02:57,201 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:57,202 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:57,202 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:57,202 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:57,203 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-17 20:02:57,203 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:57,203 DEBUG [Listener at jenkins-hbase4.apache.org/39363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-17 20:02:57,531 WARN [Listener at jenkins-hbase4.apache.org/39363] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-17 20:02:57,534 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-17 20:02:57,536 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-17 20:02:59,543 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:59,543 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-17 20:02:59,550 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0006_000001 (auth:SIMPLE) 2023-09-17 20:03:00,048 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0007_000001 (auth:SIMPLE) 2023-09-17 20:03:00,164 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 20:03:03,827 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0007_000001 (auth:SIMPLE) 2023-09-17 20:03:06,032 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0007_000001 (auth:SIMPLE) 2023-09-17 20:03:08,603 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0007_000001 (auth:SIMPLE) 2023-09-17 20:03:09,705 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-17 20:03:09,706 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-17 20:03:09,717 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:09,717 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-17 20:03:09,718 INFO [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-17 20:03:09,718 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:09,718 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-17 20:03:09,718 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-17 20:03:09,718 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-609269198_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:09,719 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-17 20:03:09,719 DEBUG [Listener at jenkins-hbase4.apache.org/39363] snapshot.TestExportSnapshot(367): hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/export-test/export-1694980976206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-17 20:03:09,724 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:09,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:09,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:09,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-17 20:03:09,729 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980989729"}]},"ts":"1694980989729"} 2023-09-17 20:03:09,730 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-17 20:03:09,733 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-17 20:03:09,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cefccc0050681b34927a992947920cb4, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4067cd1004e13b957c56db8ebfad6515, UNASSIGN}] 2023-09-17 20:03:09,736 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cefccc0050681b34927a992947920cb4, UNASSIGN 2023-09-17 20:03:09,736 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4067cd1004e13b957c56db8ebfad6515, UNASSIGN 2023-09-17 20:03:09,736 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=cefccc0050681b34927a992947920cb4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:03:09,736 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=4067cd1004e13b957c56db8ebfad6515, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:03:09,737 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980989736"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980989736"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980989736"}]},"ts":"1694980989736"} 2023-09-17 20:03:09,737 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980989736"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694980989736"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694980989736"}]},"ts":"1694980989736"} 2023-09-17 20:03:09,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 4067cd1004e13b957c56db8ebfad6515, server=jenkins-hbase4.apache.org,41855,1694980876397}] 2023-09-17 20:03:09,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure cefccc0050681b34927a992947920cb4, server=jenkins-hbase4.apache.org,35419,1694980876302}] 2023-09-17 20:03:09,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-17 20:03:09,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cefccc0050681b34927a992947920cb4 2023-09-17 20:03:09,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:03:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cefccc0050681b34927a992947920cb4, disabling compactions & flushes 2023-09-17 20:03:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4067cd1004e13b957c56db8ebfad6515, disabling compactions & flushes 2023-09-17 20:03:09,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:03:09,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:03:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:03:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:03:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. after waiting 0 ms 2023-09-17 20:03:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:03:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. after waiting 0 ms 2023-09-17 20:03:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:03:09,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:03:09,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:03:09,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:03:09,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:03:09,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4. 2023-09-17 20:03:09,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cefccc0050681b34927a992947920cb4: 2023-09-17 20:03:09,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515. 2023-09-17 20:03:09,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4067cd1004e13b957c56db8ebfad6515: 2023-09-17 20:03:09,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cefccc0050681b34927a992947920cb4 2023-09-17 20:03:09,909 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=cefccc0050681b34927a992947920cb4, regionState=CLOSED 2023-09-17 20:03:09,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:03:09,909 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980989909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980989909"}]},"ts":"1694980989909"} 2023-09-17 20:03:09,909 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=4067cd1004e13b957c56db8ebfad6515, regionState=CLOSED 2023-09-17 20:03:09,909 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694980989909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694980989909"}]},"ts":"1694980989909"} 2023-09-17 20:03:09,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-17 20:03:09,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure cefccc0050681b34927a992947920cb4, server=jenkins-hbase4.apache.org,35419,1694980876302 in 171 msec 2023-09-17 20:03:09,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-17 20:03:09,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 4067cd1004e13b957c56db8ebfad6515, server=jenkins-hbase4.apache.org,41855,1694980876397 in 173 msec 2023-09-17 20:03:09,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cefccc0050681b34927a992947920cb4, UNASSIGN in 179 msec 2023-09-17 20:03:09,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-17 20:03:09,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4067cd1004e13b957c56db8ebfad6515, UNASSIGN in 179 msec 2023-09-17 20:03:09,915 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694980989915"}]},"ts":"1694980989915"} 2023-09-17 20:03:09,916 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-17 20:03:09,917 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-17 20:03:09,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 193 msec 2023-09-17 20:03:10,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-17 20:03:10,032 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-17 20:03:10,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,035 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,036 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,037 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45281] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,039 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4 2023-09-17 20:03:10,039 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:03:10,040 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,040 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,040 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,040 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-17 20:03:10,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-17 20:03:10,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-17 20:03:10,041 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/recovered.edits] 2023-09-17 20:03:10,041 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/cf, FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/recovered.edits] 2023-09-17 20:03:10,042 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,042 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:03:10,042 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,042 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-17 20:03:10,042 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:03:10,042 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,042 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-17 20:03:10,042 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:03:10,042 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-17 20:03:10,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-17 20:03:10,045 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/cf/7460cebdc8ad4e57b4dfe480a5554227 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/cf/7460cebdc8ad4e57b4dfe480a5554227 2023-09-17 20:03:10,046 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/cf/0a241e7c4b314b7bbca366fb5b1f0b7a to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/cf/0a241e7c4b314b7bbca366fb5b1f0b7a 2023-09-17 20:03:10,049 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4/recovered.edits/9.seqid 2023-09-17 20:03:10,049 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/recovered.edits/9.seqid to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515/recovered.edits/9.seqid 2023-09-17 20:03:10,049 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cefccc0050681b34927a992947920cb4 2023-09-17 20:03:10,049 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4067cd1004e13b957c56db8ebfad6515 2023-09-17 20:03:10,049 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-17 20:03:10,050 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-17 20:03:10,051 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-17 20:03:10,054 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917eb5dc02622a94e4f9a0b1c423eb6f7bc to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230917eb5dc02622a94e4f9a0b1c423eb6f7bc 2023-09-17 20:03:10,056 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917274358bba1d54a56854f5a38795d8a67 to hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230917274358bba1d54a56854f5a38795d8a67 2023-09-17 20:03:10,056 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-17 20:03:10,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,060 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-17 20:03:10,062 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-17 20:03:10,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-17 20:03:10,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980990063"}]},"ts":"9223372036854775807"} 2023-09-17 20:03:10,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694980990063"}]},"ts":"9223372036854775807"} 2023-09-17 20:03:10,064 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-17 20:03:10,064 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cefccc0050681b34927a992947920cb4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694980974888.cefccc0050681b34927a992947920cb4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4067cd1004e13b957c56db8ebfad6515, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694980974888.4067cd1004e13b957c56db8ebfad6515.', STARTKEY => '1', ENDKEY => ''}] 2023-09-17 20:03:10,064 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-17 20:03:10,065 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694980990064"}]},"ts":"9223372036854775807"} 2023-09-17 20:03:10,066 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-17 20:03:10,067 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 36 msec 2023-09-17 20:03:10,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-17 20:03:10,144 INFO [Listener at jenkins-hbase4.apache.org/39363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-17 20:03:10,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-17 20:03:10,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-17 20:03:10,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46221] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-17 20:03:10,178 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 766), OpenFileDescriptor=908 (was 943), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=144 (was 147), ProcessCount=168 (was 168), AvailableMemoryMB=8952 (was 8981) 2023-09-17 20:03:10,178 WARN [Listener at jenkins-hbase4.apache.org/39363] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-17 20:03:10,178 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-17 20:03:10,188 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-17 20:03:14,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694980882764_0007_000001 (auth:SIMPLE) 2023-09-17 20:03:15,476 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-17 20:03:24,311 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-17 20:03:38,427 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-17 20:03:38,427 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-17 20:03:38,535 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-17 20:03:38,542 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-17 20:03:38,544 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-17 20:03:38,555 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-17 20:03:38,658 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-17 20:03:38,658 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-17 20:03:38,659 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-17 20:03:38,659 INFO [Listener at jenkins-hbase4.apache.org/39363] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-17 20:03:38,659 DEBUG [Listener at jenkins-hbase4.apache.org/39363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60312a8b to 127.0.0.1:62829 2023-09-17 20:03:38,659 DEBUG [Listener at jenkins-hbase4.apache.org/39363] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:03:38,659 DEBUG [Listener at jenkins-hbase4.apache.org/39363] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-17 20:03:38,659 DEBUG [Listener at jenkins-hbase4.apache.org/39363] util.JVMClusterUtil(257): Found active master hash=1753456086, stopped=false 2023-09-17 20:03:38,659 DEBUG [Listener at jenkins-hbase4.apache.org/39363] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:03:38,659 DEBUG [Listener at jenkins-hbase4.apache.org/39363] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-17 20:03:38,659 INFO [Listener at jenkins-hbase4.apache.org/39363] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:03:38,661 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-17 20:03:38,661 INFO [Listener at jenkins-hbase4.apache.org/39363] procedure2.ProcedureExecutor(628): Stopping 2023-09-17 20:03:38,661 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-17 20:03:38,661 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-17 20:03:38,661 DEBUG [Listener at jenkins-hbase4.apache.org/39363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48768fb9 to 127.0.0.1:62829 2023-09-17 20:03:38,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 20:03:38,661 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:03:38,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 20:03:38,661 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-17 20:03:38,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 20:03:38,661 DEBUG [Listener at jenkins-hbase4.apache.org/39363] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:03:38,662 INFO [Listener at jenkins-hbase4.apache.org/39363] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35419,1694980876302' ***** 2023-09-17 20:03:38,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-17 20:03:38,662 DEBUG [Listener at jenkins-hbase4.apache.org/39363] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:03:38,662 INFO [Listener at jenkins-hbase4.apache.org/39363] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-17 20:03:38,662 INFO [Listener at jenkins-hbase4.apache.org/39363] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45281,1694980876357' ***** 2023-09-17 20:03:38,662 DEBUG [Listener at jenkins-hbase4.apache.org/39363] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:03:38,662 INFO [Listener at jenkins-hbase4.apache.org/39363] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-17 20:03:38,662 INFO [Listener at jenkins-hbase4.apache.org/39363] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41855,1694980876397' ***** 2023-09-17 20:03:38,662 INFO [RS:0;jenkins-hbase4:35419] regionserver.HeapMemoryManager(220): Stopping 2023-09-17 20:03:38,663 INFO [RS:1;jenkins-hbase4:45281] regionserver.HeapMemoryManager(220): Stopping 2023-09-17 20:03:38,663 DEBUG [Listener at jenkins-hbase4.apache.org/39363] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:03:38,663 INFO [RS:0;jenkins-hbase4:35419] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-17 20:03:38,663 INFO [RS:1;jenkins-hbase4:45281] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-17 20:03:38,663 INFO [RS:0;jenkins-hbase4:35419] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-17 20:03:38,663 INFO [RS:1;jenkins-hbase4:45281] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-17 20:03:38,663 INFO [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:03:38,663 INFO [Listener at jenkins-hbase4.apache.org/39363] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-17 20:03:38,663 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-17 20:03:38,663 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(3305): Received CLOSE for 48895dcec4e0ce8835cfb75a33d89235 2023-09-17 20:03:38,663 INFO [RS:2;jenkins-hbase4:41855] regionserver.HeapMemoryManager(220): Stopping 2023-09-17 20:03:38,663 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-17 20:03:38,663 INFO [RS:2;jenkins-hbase4:41855] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-17 20:03:38,663 INFO [RS:2;jenkins-hbase4:41855] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-17 20:03:38,664 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:03:38,664 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(3305): Received CLOSE for 9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:03:38,664 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:03:38,663 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-17 20:03:38,665 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ec81448 to 127.0.0.1:62829 2023-09-17 20:03:38,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 48895dcec4e0ce8835cfb75a33d89235, disabling compactions & flushes 2023-09-17 20:03:38,664 DEBUG [RS:2;jenkins-hbase4:41855] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17fe48f2 to 127.0.0.1:62829 2023-09-17 20:03:38,663 DEBUG [RS:0;jenkins-hbase4:35419] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e33bcb9 to 127.0.0.1:62829 2023-09-17 20:03:38,665 DEBUG [RS:2;jenkins-hbase4:41855] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:03:38,665 DEBUG [RS:0;jenkins-hbase4:35419] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:03:38,667 INFO [RS:2;jenkins-hbase4:41855] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-17 20:03:38,668 INFO [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35419,1694980876302; all regions closed. 2023-09-17 20:03:38,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:03:38,665 DEBUG [RS:1;jenkins-hbase4:45281] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:03:38,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:03:38,668 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-17 20:03:38,668 INFO [RS:2;jenkins-hbase4:41855] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-17 20:03:38,668 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1478): Online Regions={48895dcec4e0ce8835cfb75a33d89235=hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235., 9f997e734cba795e8cbbbb5e1fe66de2=hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2.} 2023-09-17 20:03:38,668 INFO [RS:2;jenkins-hbase4:41855] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-17 20:03:38,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. after waiting 0 ms 2023-09-17 20:03:38,669 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-17 20:03:38,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:03:38,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 48895dcec4e0ce8835cfb75a33d89235 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-17 20:03:38,669 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-17 20:03:38,669 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-17 20:03:38,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-17 20:03:38,669 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-17 20:03:38,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-17 20:03:38,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-17 20:03:38,670 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-17 20:03:38,670 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-17 20:03:38,670 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1504): Waiting on 48895dcec4e0ce8835cfb75a33d89235, 9f997e734cba795e8cbbbb5e1fe66de2 2023-09-17 20:03:38,670 DEBUG [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-17 20:03:38,685 DEBUG [RS:0;jenkins-hbase4:35419] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/oldWALs 2023-09-17 20:03:38,685 INFO [RS:0;jenkins-hbase4:35419] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35419%2C1694980876302:(num 1694980878061) 2023-09-17 20:03:38,685 DEBUG [RS:0;jenkins-hbase4:35419] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:03:38,685 INFO [RS:0;jenkins-hbase4:35419] regionserver.LeaseManager(133): Closed leases 2023-09-17 20:03:38,689 INFO [RS:0;jenkins-hbase4:35419] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-17 20:03:38,689 INFO [RS:0;jenkins-hbase4:35419] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-17 20:03:38,689 INFO [RS:0;jenkins-hbase4:35419] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-17 20:03:38,689 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-17 20:03:38,689 INFO [RS:0;jenkins-hbase4:35419] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-17 20:03:38,690 INFO [RS:0;jenkins-hbase4:35419] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35419 2023-09-17 20:03:38,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/.tmp/info/63087b15d9f44c308c45dddc0c1628bf 2023-09-17 20:03:38,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235/.tmp/info/73329dda666d4360be1d024659376ab7 2023-09-17 20:03:38,697 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:03:38,697 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:03:38,697 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35419,1694980876302 2023-09-17 20:03:38,697 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 20:03:38,697 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 20:03:38,697 ERROR [Listener at localhost/34359-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@735e9c43 rejected from java.util.concurrent.ThreadPoolExecutor@776116f0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 110] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-09-17 20:03:38,697 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 20:03:38,697 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35419,1694980876302] 2023-09-17 20:03:38,697 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 20:03:38,698 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35419,1694980876302; numProcessing=1 2023-09-17 20:03:38,699 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-17 20:03:38,699 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-17 20:03:38,700 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35419,1694980876302 already deleted, retry=false 2023-09-17 20:03:38,700 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35419,1694980876302 expired; onlineServers=2 2023-09-17 20:03:38,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235/.tmp/info/73329dda666d4360be1d024659376ab7 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235/info/73329dda666d4360be1d024659376ab7 2023-09-17 20:03:38,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63087b15d9f44c308c45dddc0c1628bf 2023-09-17 20:03:38,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235/info/73329dda666d4360be1d024659376ab7, entries=2, sequenceid=6, filesize=4.8 K 2023-09-17 20:03:38,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 48895dcec4e0ce8835cfb75a33d89235 in 39ms, sequenceid=6, compaction requested=false 2023-09-17 20:03:38,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/namespace/48895dcec4e0ce8835cfb75a33d89235/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-17 20:03:38,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:03:38,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:03:38,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 48895dcec4e0ce8835cfb75a33d89235: 2023-09-17 20:03:38,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694980878459.48895dcec4e0ce8835cfb75a33d89235. 2023-09-17 20:03:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f997e734cba795e8cbbbb5e1fe66de2, disabling compactions & flushes 2023-09-17 20:03:38,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:03:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:03:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. after waiting 0 ms 2023-09-17 20:03:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:03:38,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9f997e734cba795e8cbbbb5e1fe66de2 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-17 20:03:38,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/.tmp/rep_barrier/e55f54abd0d84f7f9de668f76f971fa8 2023-09-17 20:03:38,726 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e55f54abd0d84f7f9de668f76f971fa8 2023-09-17 20:03:38,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2/.tmp/l/3c724690a77243958cfc7c4d1a0a91fb 2023-09-17 20:03:38,736 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-17 20:03:38,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c724690a77243958cfc7c4d1a0a91fb 2023-09-17 20:03:38,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2/.tmp/l/3c724690a77243958cfc7c4d1a0a91fb as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2/l/3c724690a77243958cfc7c4d1a0a91fb 2023-09-17 20:03:38,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/.tmp/table/66bcabe3a66d416db7ea284f3ab774ee 2023-09-17 20:03:38,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c724690a77243958cfc7c4d1a0a91fb 2023-09-17 20:03:38,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2/l/3c724690a77243958cfc7c4d1a0a91fb, entries=7, sequenceid=18, filesize=5.2 K 2023-09-17 20:03:38,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 9f997e734cba795e8cbbbb5e1fe66de2 in 26ms, sequenceid=18, compaction requested=false 2023-09-17 20:03:38,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66bcabe3a66d416db7ea284f3ab774ee 2023-09-17 20:03:38,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/.tmp/info/63087b15d9f44c308c45dddc0c1628bf as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/info/63087b15d9f44c308c45dddc0c1628bf 2023-09-17 20:03:38,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/acl/9f997e734cba795e8cbbbb5e1fe66de2/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-17 20:03:38,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:03:38,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:03:38,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f997e734cba795e8cbbbb5e1fe66de2: 2023-09-17 20:03:38,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694980879211.9f997e734cba795e8cbbbb5e1fe66de2. 2023-09-17 20:03:38,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63087b15d9f44c308c45dddc0c1628bf 2023-09-17 20:03:38,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/info/63087b15d9f44c308c45dddc0c1628bf, entries=48, sequenceid=131, filesize=10.3 K 2023-09-17 20:03:38,757 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/.tmp/rep_barrier/e55f54abd0d84f7f9de668f76f971fa8 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/rep_barrier/e55f54abd0d84f7f9de668f76f971fa8 2023-09-17 20:03:38,761 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e55f54abd0d84f7f9de668f76f971fa8 2023-09-17 20:03:38,761 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/rep_barrier/e55f54abd0d84f7f9de668f76f971fa8, entries=13, sequenceid=131, filesize=6.4 K 2023-09-17 20:03:38,762 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/.tmp/table/66bcabe3a66d416db7ea284f3ab774ee as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/table/66bcabe3a66d416db7ea284f3ab774ee 2023-09-17 20:03:38,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66bcabe3a66d416db7ea284f3ab774ee 2023-09-17 20:03:38,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/table/66bcabe3a66d416db7ea284f3ab774ee, entries=24, sequenceid=131, filesize=6.9 K 2023-09-17 20:03:38,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 97ms, sequenceid=131, compaction requested=false 2023-09-17 20:03:38,778 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-17 20:03:38,779 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-17 20:03:38,779 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-17 20:03:38,780 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-17 20:03:38,780 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-17 20:03:38,780 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-17 20:03:38,799 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 20:03:38,799 INFO [RS:0;jenkins-hbase4:35419] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35419,1694980876302; zookeeper connection closed. 2023-09-17 20:03:38,799 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:35419-0x100bb7ad6d00001, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 20:03:38,799 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@194e2fe4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@194e2fe4 2023-09-17 20:03:38,870 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45281,1694980876357; all regions closed. 2023-09-17 20:03:38,870 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41855,1694980876397; all regions closed. 2023-09-17 20:03:38,877 DEBUG [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/oldWALs 2023-09-17 20:03:38,877 DEBUG [RS:2;jenkins-hbase4:41855] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/oldWALs 2023-09-17 20:03:38,877 INFO [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45281%2C1694980876357:(num 1694980878061) 2023-09-17 20:03:38,877 DEBUG [RS:1;jenkins-hbase4:45281] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:03:38,877 INFO [RS:2;jenkins-hbase4:41855] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41855%2C1694980876397.meta:.meta(num 1694980878183) 2023-09-17 20:03:38,877 INFO [RS:1;jenkins-hbase4:45281] regionserver.LeaseManager(133): Closed leases 2023-09-17 20:03:38,878 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-17 20:03:38,878 INFO [RS:1;jenkins-hbase4:45281] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-17 20:03:38,878 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-17 20:03:38,878 INFO [RS:1;jenkins-hbase4:45281] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-17 20:03:38,878 INFO [RS:1;jenkins-hbase4:45281] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-17 20:03:38,879 INFO [RS:1;jenkins-hbase4:45281] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45281 2023-09-17 20:03:38,881 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:03:38,881 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 20:03:38,882 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45281,1694980876357 2023-09-17 20:03:38,882 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45281,1694980876357] 2023-09-17 20:03:38,882 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45281,1694980876357; numProcessing=2 2023-09-17 20:03:38,883 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45281,1694980876357 already deleted, retry=false 2023-09-17 20:03:38,883 DEBUG [RS:2;jenkins-hbase4:41855] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/oldWALs 2023-09-17 20:03:38,883 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45281,1694980876357 expired; onlineServers=1 2023-09-17 20:03:38,884 INFO [RS:2;jenkins-hbase4:41855] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41855%2C1694980876397:(num 1694980878061) 2023-09-17 20:03:38,884 DEBUG [RS:2;jenkins-hbase4:41855] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:03:38,884 INFO [RS:2;jenkins-hbase4:41855] regionserver.LeaseManager(133): Closed leases 2023-09-17 20:03:38,884 INFO [RS:2;jenkins-hbase4:41855] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-17 20:03:38,884 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-17 20:03:38,885 INFO [RS:2;jenkins-hbase4:41855] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41855 2023-09-17 20:03:38,887 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41855,1694980876397 2023-09-17 20:03:38,887 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-17 20:03:38,888 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41855,1694980876397] 2023-09-17 20:03:38,888 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41855,1694980876397; numProcessing=3 2023-09-17 20:03:38,889 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41855,1694980876397 already deleted, retry=false 2023-09-17 20:03:38,889 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41855,1694980876397 expired; onlineServers=0 2023-09-17 20:03:38,889 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46221,1694980874966' ***** 2023-09-17 20:03:38,889 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-17 20:03:38,889 DEBUG [M:0;jenkins-hbase4:46221] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29be97ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-17 20:03:38,889 INFO [M:0;jenkins-hbase4:46221] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46221,1694980874966 2023-09-17 20:03:38,889 INFO [M:0;jenkins-hbase4:46221] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46221,1694980874966; all regions closed. 2023-09-17 20:03:38,889 DEBUG [M:0;jenkins-hbase4:46221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-17 20:03:38,889 DEBUG [M:0;jenkins-hbase4:46221] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-17 20:03:38,889 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-17 20:03:38,889 DEBUG [M:0;jenkins-hbase4:46221] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-17 20:03:38,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694980877669] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694980877669,5,FailOnTimeoutGroup] 2023-09-17 20:03:38,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694980877670] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694980877670,5,FailOnTimeoutGroup] 2023-09-17 20:03:38,890 INFO [M:0;jenkins-hbase4:46221] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-17 20:03:38,890 INFO [M:0;jenkins-hbase4:46221] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-17 20:03:38,890 INFO [M:0;jenkins-hbase4:46221] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-17 20:03:38,890 DEBUG [M:0;jenkins-hbase4:46221] master.HMaster(1512): Stopping service threads 2023-09-17 20:03:38,890 INFO [M:0;jenkins-hbase4:46221] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-17 20:03:38,890 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-17 20:03:38,890 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-17 20:03:38,890 ERROR [M:0;jenkins-hbase4:46221] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-17 20:03:38,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-17 20:03:38,891 INFO [M:0;jenkins-hbase4:46221] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-17 20:03:38,891 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-17 20:03:38,891 DEBUG [M:0;jenkins-hbase4:46221] zookeeper.ZKUtil(398): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-17 20:03:38,891 WARN [M:0;jenkins-hbase4:46221] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-17 20:03:38,891 INFO [M:0;jenkins-hbase4:46221] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-17 20:03:38,891 INFO [M:0;jenkins-hbase4:46221] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-17 20:03:38,892 DEBUG [M:0;jenkins-hbase4:46221] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-17 20:03:38,892 INFO [M:0;jenkins-hbase4:46221] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 20:03:38,892 DEBUG [M:0;jenkins-hbase4:46221] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 20:03:38,892 DEBUG [M:0;jenkins-hbase4:46221] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-17 20:03:38,892 DEBUG [M:0;jenkins-hbase4:46221] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 20:03:38,892 INFO [M:0;jenkins-hbase4:46221] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.93 KB heapSize=452.16 KB 2023-09-17 20:03:38,905 INFO [M:0;jenkins-hbase4:46221] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.93 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a3810781ff6a47d99b2c2e22aef9b6b4 2023-09-17 20:03:38,908 INFO [M:0;jenkins-hbase4:46221] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3810781ff6a47d99b2c2e22aef9b6b4 2023-09-17 20:03:38,908 DEBUG [M:0;jenkins-hbase4:46221] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a3810781ff6a47d99b2c2e22aef9b6b4 as hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a3810781ff6a47d99b2c2e22aef9b6b4 2023-09-17 20:03:38,912 INFO [M:0;jenkins-hbase4:46221] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3810781ff6a47d99b2c2e22aef9b6b4 2023-09-17 20:03:38,912 INFO [M:0;jenkins-hbase4:46221] regionserver.HStore(1080): Added hdfs://localhost:36291/user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a3810781ff6a47d99b2c2e22aef9b6b4, entries=119, sequenceid=899, filesize=28.7 K 2023-09-17 20:03:38,913 INFO [M:0;jenkins-hbase4:46221] regionserver.HRegion(2948): Finished flush of dataSize ~375.93 KB/384948, heapSize ~452.15 KB/463000, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-09-17 20:03:38,914 INFO [M:0;jenkins-hbase4:46221] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-17 20:03:38,914 DEBUG [M:0;jenkins-hbase4:46221] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-17 20:03:38,917 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/0ea8e34e-20ba-b2d2-9a1d-5052a44bf05c/MasterData/WALs/jenkins-hbase4.apache.org,46221,1694980874966/jenkins-hbase4.apache.org%2C46221%2C1694980874966.1694980876880 not finished, retry = 0 2023-09-17 20:03:38,983 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 20:03:38,983 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x100bb7ad6d00002, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 20:03:38,983 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45281,1694980876357; zookeeper connection closed. 2023-09-17 20:03:38,983 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@41d0ebc4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@41d0ebc4 2023-09-17 20:03:39,018 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-17 20:03:39,018 INFO [M:0;jenkins-hbase4:46221] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-17 20:03:39,019 INFO [M:0;jenkins-hbase4:46221] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46221 2023-09-17 20:03:39,021 DEBUG [M:0;jenkins-hbase4:46221] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46221,1694980874966 already deleted, retry=false 2023-09-17 20:03:39,083 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 20:03:39,083 INFO [RS:2;jenkins-hbase4:41855] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41855,1694980876397; zookeeper connection closed. 2023-09-17 20:03:39,083 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): regionserver:41855-0x100bb7ad6d00003, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 20:03:39,083 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6e7bf7fc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6e7bf7fc 2023-09-17 20:03:39,084 INFO [Listener at jenkins-hbase4.apache.org/39363] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-17 20:03:39,183 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 20:03:39,183 DEBUG [Listener at localhost/34359-EventThread] zookeeper.ZKWatcher(600): master:46221-0x100bb7ad6d00000, quorum=127.0.0.1:62829, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-17 20:03:39,183 INFO [M:0;jenkins-hbase4:46221] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46221,1694980874966; zookeeper connection closed. 2023-09-17 20:03:39,185 WARN [Listener at jenkins-hbase4.apache.org/39363] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-17 20:03:39,188 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-17 20:03:39,292 WARN [BP-1346331081-172.31.14.131-1694980871193 heartbeating to localhost/127.0.0.1:36291] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-17 20:03:39,292 WARN [BP-1346331081-172.31.14.131-1694980871193 heartbeating to localhost/127.0.0.1:36291] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1346331081-172.31.14.131-1694980871193 (Datanode Uuid 6d2d5653-97ed-440d-9e44-26d7a9e12c2f) service to localhost/127.0.0.1:36291 2023-09-17 20:03:39,294 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data5/current/BP-1346331081-172.31.14.131-1694980871193] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 20:03:39,294 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data6/current/BP-1346331081-172.31.14.131-1694980871193] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 20:03:39,295 WARN [Listener at jenkins-hbase4.apache.org/39363] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-17 20:03:39,297 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-17 20:03:39,400 WARN [BP-1346331081-172.31.14.131-1694980871193 heartbeating to localhost/127.0.0.1:36291] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-17 20:03:39,401 WARN [BP-1346331081-172.31.14.131-1694980871193 heartbeating to localhost/127.0.0.1:36291] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1346331081-172.31.14.131-1694980871193 (Datanode Uuid 2dc8d76b-8e73-4c09-9ace-55754103c6d3) service to localhost/127.0.0.1:36291 2023-09-17 20:03:39,401 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data3/current/BP-1346331081-172.31.14.131-1694980871193] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 20:03:39,401 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data4/current/BP-1346331081-172.31.14.131-1694980871193] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 20:03:39,402 WARN [Listener at jenkins-hbase4.apache.org/39363] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-17 20:03:39,405 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-17 20:03:39,507 WARN [BP-1346331081-172.31.14.131-1694980871193 heartbeating to localhost/127.0.0.1:36291] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-17 20:03:39,508 WARN [BP-1346331081-172.31.14.131-1694980871193 heartbeating to localhost/127.0.0.1:36291] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1346331081-172.31.14.131-1694980871193 (Datanode Uuid fb98433f-5757-430a-9d7e-2187cbb0f170) service to localhost/127.0.0.1:36291 2023-09-17 20:03:39,508 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data1/current/BP-1346331081-172.31.14.131-1694980871193] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 20:03:39,508 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ef841045-be4d-91b3-b5d3-ef3510011963/cluster_6c8760d1-0804-db40-a9c5-293a7a4a6dc7/dfs/data/data2/current/BP-1346331081-172.31.14.131-1694980871193] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-17 20:03:39,530 INFO [Listener at jenkins-hbase4.apache.org/39363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-17 20:03:39,656 INFO [Listener at jenkins-hbase4.apache.org/39363] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-17 20:03:39,740 INFO [Listener at jenkins-hbase4.apache.org/39363] hbase.HBaseTestingUtility(1293): Minicluster is down