2023-10-06 10:10:22,686 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-06 10:10:23,030 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20 2023-10-06 10:10:23,031 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-06 10:10:23,031 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-06 10:10:23,087 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-06 10:10:23,433 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-06 10:10:23,434 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa, deleteOnExit=true 2023-10-06 10:10:23,434 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-06 10:10:23,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/test.cache.data in system properties and HBase conf 2023-10-06 10:10:23,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop.tmp.dir in system properties and HBase conf 2023-10-06 10:10:23,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop.log.dir in system properties and HBase conf 2023-10-06 10:10:23,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-06 10:10:23,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-06 10:10:23,439 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-06 10:10:24,013 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-06 10:10:24,021 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-06 10:10:24,021 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-06 10:10:24,022 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-06 10:10:24,023 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 10:10:24,023 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-06 10:10:24,024 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-06 10:10:24,025 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 10:10:24,027 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 10:10:24,028 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-06 10:10:24,028 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/nfs.dump.dir in system properties and HBase conf 2023-10-06 10:10:24,028 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir in system properties and HBase conf 2023-10-06 10:10:24,029 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 10:10:24,029 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-06 10:10:24,030 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-06 10:10:24,897 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-06 10:10:24,905 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-06 10:10:25,232 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-06 10:10:25,452 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-06 10:10:25,474 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 10:10:25,533 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 10:10:25,581 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir/Jetty_localhost_45639_hdfs____obqpb9/webapp 2023-10-06 10:10:25,716 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45639 2023-10-06 10:10:25,730 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-06 10:10:25,731 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-06 10:10:26,707 WARN [Listener at localhost/43027] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 10:10:26,959 WARN [Listener at localhost/43027] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-06 10:10:27,008 WARN [Listener at localhost/43027] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 10:10:27,024 INFO [Listener at localhost/43027] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 10:10:27,054 INFO [Listener at localhost/43027] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir/Jetty_localhost_45855_datanode____xa68m6/webapp 2023-10-06 10:10:27,227 INFO [Listener at localhost/43027] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45855 2023-10-06 10:10:27,956 WARN [Listener at localhost/34087] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 10:10:28,026 WARN [Listener at localhost/34087] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-06 10:10:28,042 WARN [Listener at localhost/34087] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 10:10:28,052 INFO [Listener at localhost/34087] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 10:10:28,075 INFO [Listener at localhost/34087] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir/Jetty_localhost_43549_datanode____zcsfeq/webapp 2023-10-06 10:10:28,211 INFO [Listener at localhost/34087] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43549 2023-10-06 10:10:28,225 WARN [Listener at localhost/45241] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 10:10:28,259 WARN [Listener at localhost/45241] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-06 10:10:28,265 WARN [Listener at localhost/45241] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 10:10:28,266 INFO [Listener at localhost/45241] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 10:10:28,278 INFO [Listener at localhost/45241] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir/Jetty_localhost_46559_datanode____1nwzsu/webapp 2023-10-06 10:10:28,457 INFO [Listener at localhost/45241] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46559 2023-10-06 10:10:28,492 WARN [Listener at localhost/42741] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 10:10:29,161 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8c5ac90883af1b02: Processing first storage report for DS-7533057a-e999-44d3-8d0e-e3183c3ee809 from datanode 1ca46460-86c1-40b3-978a-84abe7a0e706 2023-10-06 10:10:29,168 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8c5ac90883af1b02: from storage DS-7533057a-e999-44d3-8d0e-e3183c3ee809 node DatanodeRegistration(127.0.0.1:34543, datanodeUuid=1ca46460-86c1-40b3-978a-84abe7a0e706, infoPort=46089, infoSecurePort=0, ipcPort=45241, storageInfo=lv=-57;cid=testClusterID;nsid=1672276345;c=1696587025003), blocks: 0, hasStaleStorage: true, processing time: 6 msecs, invalidatedBlocks: 0 2023-10-06 10:10:29,168 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xee4f095cf85c5080: Processing first storage report for DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827 from datanode 8725cb7d-bdda-4a8c-a2c8-b0b1f13392af 2023-10-06 10:10:29,168 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xee4f095cf85c5080: from storage DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827 node DatanodeRegistration(127.0.0.1:37489, datanodeUuid=8725cb7d-bdda-4a8c-a2c8-b0b1f13392af, infoPort=34971, infoSecurePort=0, ipcPort=34087, storageInfo=lv=-57;cid=testClusterID;nsid=1672276345;c=1696587025003), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 10:10:29,169 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77aeac362bc5fddb: Processing first storage report for DS-611c0db4-c3a0-448e-a959-feefea02e0ba from datanode f88e656c-6275-41b7-ab3d-88ba3d3aca17 2023-10-06 10:10:29,169 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77aeac362bc5fddb: from storage DS-611c0db4-c3a0-448e-a959-feefea02e0ba node DatanodeRegistration(127.0.0.1:34205, datanodeUuid=f88e656c-6275-41b7-ab3d-88ba3d3aca17, infoPort=45249, infoSecurePort=0, ipcPort=42741, storageInfo=lv=-57;cid=testClusterID;nsid=1672276345;c=1696587025003), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 10:10:29,169 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8c5ac90883af1b02: Processing first storage report for DS-eb11c531-6fdf-4348-93fa-5f99212e1f71 from datanode 1ca46460-86c1-40b3-978a-84abe7a0e706 2023-10-06 10:10:29,170 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8c5ac90883af1b02: from storage DS-eb11c531-6fdf-4348-93fa-5f99212e1f71 node DatanodeRegistration(127.0.0.1:34543, datanodeUuid=1ca46460-86c1-40b3-978a-84abe7a0e706, infoPort=46089, infoSecurePort=0, ipcPort=45241, storageInfo=lv=-57;cid=testClusterID;nsid=1672276345;c=1696587025003), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 10:10:29,170 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xee4f095cf85c5080: Processing first storage report for DS-9ef499a7-3955-4072-a016-50713f3fb944 from datanode 8725cb7d-bdda-4a8c-a2c8-b0b1f13392af 2023-10-06 10:10:29,170 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xee4f095cf85c5080: from storage DS-9ef499a7-3955-4072-a016-50713f3fb944 node DatanodeRegistration(127.0.0.1:37489, datanodeUuid=8725cb7d-bdda-4a8c-a2c8-b0b1f13392af, infoPort=34971, infoSecurePort=0, ipcPort=34087, storageInfo=lv=-57;cid=testClusterID;nsid=1672276345;c=1696587025003), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 10:10:29,170 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77aeac362bc5fddb: Processing first storage report for DS-0aa53df5-ef53-428c-8eee-a53a967a8e91 from datanode f88e656c-6275-41b7-ab3d-88ba3d3aca17 2023-10-06 10:10:29,171 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77aeac362bc5fddb: from storage DS-0aa53df5-ef53-428c-8eee-a53a967a8e91 node DatanodeRegistration(127.0.0.1:34205, datanodeUuid=f88e656c-6275-41b7-ab3d-88ba3d3aca17, infoPort=45249, infoSecurePort=0, ipcPort=42741, storageInfo=lv=-57;cid=testClusterID;nsid=1672276345;c=1696587025003), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 10:10:29,373 DEBUG [Listener at localhost/42741] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20 2023-10-06 10:10:29,488 INFO [Listener at localhost/42741] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/zookeeper_0, clientPort=65169, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-06 10:10:29,516 INFO [Listener at localhost/42741] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=65169 2023-10-06 10:10:29,549 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:29,552 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:30,455 INFO [Listener at localhost/42741] util.FSUtils(471): Created version file at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae with version=8 2023-10-06 10:10:30,456 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/hbase-staging 2023-10-06 10:10:30,945 INFO [Listener at localhost/42741] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-06 10:10:31,453 INFO [Listener at localhost/42741] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-10-06 10:10:31,494 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:31,495 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:31,495 INFO [Listener at localhost/42741] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 10:10:31,495 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:31,496 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 10:10:31,660 INFO [Listener at localhost/42741] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 10:10:31,749 DEBUG [Listener at localhost/42741] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-06 10:10:31,857 INFO [Listener at localhost/42741] ipc.NettyRpcServer(120): Bind to /136.243.18.41:45845 2023-10-06 10:10:31,877 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:31,880 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:31,915 INFO [Listener at localhost/42741] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45845 connecting to ZooKeeper ensemble=127.0.0.1:65169 2023-10-06 10:10:32,080 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:458450x0, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 10:10:32,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45845-0x1011b35d7160000 connected 2023-10-06 10:10:32,185 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 10:10:32,187 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 10:10:32,206 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 10:10:32,217 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45845 2023-10-06 10:10:32,217 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45845 2023-10-06 10:10:32,218 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45845 2023-10-06 10:10:32,219 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45845 2023-10-06 10:10:32,220 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45845 2023-10-06 10:10:32,230 INFO [Listener at localhost/42741] master.HMaster(444): hbase.rootdir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae, hbase.cluster.distributed=false 2023-10-06 10:10:32,317 INFO [Listener at localhost/42741] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-10-06 10:10:32,317 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:32,317 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:32,317 INFO [Listener at localhost/42741] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 10:10:32,318 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:32,318 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 10:10:32,324 INFO [Listener at localhost/42741] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 10:10:32,328 INFO [Listener at localhost/42741] ipc.NettyRpcServer(120): Bind to /136.243.18.41:44159 2023-10-06 10:10:32,332 INFO [Listener at localhost/42741] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-06 10:10:32,345 INFO [Listener at localhost/42741] mob.MobFileCache(125): MobFileCache disabled 2023-10-06 10:10:32,347 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:32,350 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:32,354 INFO [Listener at localhost/42741] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44159 connecting to ZooKeeper ensemble=127.0.0.1:65169 2023-10-06 10:10:32,365 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:441590x0, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 10:10:32,367 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): regionserver:441590x0, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 10:10:32,372 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): regionserver:441590x0, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 10:10:32,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44159-0x1011b35d7160001 connected 2023-10-06 10:10:32,381 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 10:10:32,382 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44159 2023-10-06 10:10:32,382 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44159 2023-10-06 10:10:32,383 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44159 2023-10-06 10:10:32,388 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44159 2023-10-06 10:10:32,389 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44159 2023-10-06 10:10:32,407 INFO [Listener at localhost/42741] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-10-06 10:10:32,408 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:32,408 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:32,409 INFO [Listener at localhost/42741] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 10:10:32,409 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:32,414 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 10:10:32,414 INFO [Listener at localhost/42741] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 10:10:32,422 INFO [Listener at localhost/42741] ipc.NettyRpcServer(120): Bind to /136.243.18.41:40269 2023-10-06 10:10:32,424 INFO [Listener at localhost/42741] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-06 10:10:32,434 INFO [Listener at localhost/42741] mob.MobFileCache(125): MobFileCache disabled 2023-10-06 10:10:32,435 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:32,443 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:32,451 INFO [Listener at localhost/42741] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40269 connecting to ZooKeeper ensemble=127.0.0.1:65169 2023-10-06 10:10:32,454 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:402690x0, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 10:10:32,456 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 10:10:32,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40269-0x1011b35d7160002 connected 2023-10-06 10:10:32,457 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 10:10:32,458 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 10:10:32,460 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40269 2023-10-06 10:10:32,460 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40269 2023-10-06 10:10:32,461 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40269 2023-10-06 10:10:32,461 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40269 2023-10-06 10:10:32,462 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40269 2023-10-06 10:10:32,479 INFO [Listener at localhost/42741] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-10-06 10:10:32,479 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:32,480 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:32,480 INFO [Listener at localhost/42741] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 10:10:32,480 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 10:10:32,480 INFO [Listener at localhost/42741] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 10:10:32,481 INFO [Listener at localhost/42741] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 10:10:32,483 INFO [Listener at localhost/42741] ipc.NettyRpcServer(120): Bind to /136.243.18.41:36349 2023-10-06 10:10:32,484 INFO [Listener at localhost/42741] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-06 10:10:32,489 INFO [Listener at localhost/42741] mob.MobFileCache(125): MobFileCache disabled 2023-10-06 10:10:32,490 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:32,492 INFO [Listener at localhost/42741] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:32,494 INFO [Listener at localhost/42741] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36349 connecting to ZooKeeper ensemble=127.0.0.1:65169 2023-10-06 10:10:32,500 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:363490x0, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 10:10:32,501 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): regionserver:363490x0, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 10:10:32,504 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): regionserver:363490x0, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 10:10:32,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36349-0x1011b35d7160003 connected 2023-10-06 10:10:32,505 DEBUG [Listener at localhost/42741] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 10:10:32,509 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36349 2023-10-06 10:10:32,516 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36349 2023-10-06 10:10:32,517 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36349 2023-10-06 10:10:32,518 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36349 2023-10-06 10:10:32,518 DEBUG [Listener at localhost/42741] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36349 2023-10-06 10:10:32,522 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:10:32,534 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-06 10:10:32,536 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:10:32,789 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 10:10:32,790 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 10:10:32,791 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 10:10:32,791 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 10:10:32,792 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:10:32,796 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-06 10:10:32,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-06 10:10:32,798 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,45845,1696587030680 from backup master directory 2023-10-06 10:10:33,006 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:10:33,006 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-06 10:10:33,007 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 10:10:33,007 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:10:33,013 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-06 10:10:33,015 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-06 10:10:33,196 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/hbase.id with ID: 48c6ef70-5c07-4cb3-ae1f-44037b9a5bef 2023-10-06 10:10:33,362 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 10:10:33,411 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:10:33,562 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x60b6a908 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:10:33,677 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ee7ce87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:10:33,712 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-06 10:10:33,715 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-06 10:10:33,752 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-06 10:10:33,752 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-06 10:10:33,756 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-06 10:10:33,764 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-06 10:10:33,766 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 10:10:33,838 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/data/master/store-tmp 2023-10-06 10:10:33,950 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:33,950 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-06 10:10:33,950 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 10:10:33,950 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 10:10:33,950 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-06 10:10:33,951 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 10:10:33,951 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 10:10:33,951 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-06 10:10:33,958 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/WALs/jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:10:34,010 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C45845%2C1696587030680, suffix=, logDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/WALs/jenkins-hbase17.apache.org,45845,1696587030680, archiveDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/oldWALs, maxLogs=10 2023-10-06 10:10:34,126 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK] 2023-10-06 10:10:34,125 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK] 2023-10-06 10:10:34,131 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK] 2023-10-06 10:10:34,142 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-06 10:10:34,239 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/WALs/jenkins-hbase17.apache.org,45845,1696587030680/jenkins-hbase17.apache.org%2C45845%2C1696587030680.1696587034026 2023-10-06 10:10:34,239 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK], DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK], DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK]] 2023-10-06 10:10:34,240 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-06 10:10:34,241 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:34,247 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-06 10:10:34,252 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-06 10:10:34,361 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-06 10:10:34,374 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-06 10:10:34,413 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-06 10:10:34,429 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:34,437 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-06 10:10:34,439 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-06 10:10:34,462 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-06 10:10:34,473 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:10:34,476 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71604668, jitterRate=0.06699270009994507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:10:34,476 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-06 10:10:34,478 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-06 10:10:34,507 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-06 10:10:34,507 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-06 10:10:34,512 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-06 10:10:34,514 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-06 10:10:34,563 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 49 msec 2023-10-06 10:10:34,564 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-06 10:10:34,608 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-06 10:10:34,615 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-06 10:10:34,646 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-06 10:10:34,655 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-06 10:10:34,661 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-06 10:10:34,669 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-06 10:10:34,677 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-06 10:10:34,686 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-06 10:10:34,687 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-06 10:10:34,689 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:10:34,730 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-06 10:10:34,736 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 10:10:34,737 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 10:10:34,737 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 10:10:34,737 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:10:34,737 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 10:10:34,742 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,45845,1696587030680, sessionid=0x1011b35d7160000, setting cluster-up flag (Was=false) 2023-10-06 10:10:34,766 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:10:34,771 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-06 10:10:34,772 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:10:34,780 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:10:34,785 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-06 10:10:34,786 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:10:34,794 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp 2023-10-06 10:10:34,848 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(951): ClusterId : 48c6ef70-5c07-4cb3-ae1f-44037b9a5bef 2023-10-06 10:10:34,849 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(951): ClusterId : 48c6ef70-5c07-4cb3-ae1f-44037b9a5bef 2023-10-06 10:10:34,850 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(951): ClusterId : 48c6ef70-5c07-4cb3-ae1f-44037b9a5bef 2023-10-06 10:10:34,857 DEBUG [RS:1;jenkins-hbase17:40269] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-06 10:10:34,857 DEBUG [RS:0;jenkins-hbase17:44159] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-06 10:10:34,857 DEBUG [RS:2;jenkins-hbase17:36349] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-06 10:10:34,871 DEBUG [RS:2;jenkins-hbase17:36349] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-06 10:10:34,871 DEBUG [RS:0;jenkins-hbase17:44159] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-06 10:10:34,871 DEBUG [RS:2;jenkins-hbase17:36349] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-06 10:10:34,871 DEBUG [RS:0;jenkins-hbase17:44159] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-06 10:10:34,873 DEBUG [RS:1;jenkins-hbase17:40269] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-06 10:10:34,873 DEBUG [RS:1;jenkins-hbase17:40269] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-06 10:10:34,876 DEBUG [RS:2;jenkins-hbase17:36349] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-06 10:10:34,880 DEBUG [RS:2;jenkins-hbase17:36349] zookeeper.ReadOnlyZKClient(139): Connect 0x6c125899 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:10:34,881 DEBUG [RS:0;jenkins-hbase17:44159] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-06 10:10:34,888 DEBUG [RS:1;jenkins-hbase17:40269] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-06 10:10:34,890 DEBUG [RS:0;jenkins-hbase17:44159] zookeeper.ReadOnlyZKClient(139): Connect 0x62f1e446 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:10:34,922 DEBUG [RS:1;jenkins-hbase17:40269] zookeeper.ReadOnlyZKClient(139): Connect 0x65397fd3 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:10:34,968 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-06 10:10:34,957 DEBUG [RS:2;jenkins-hbase17:36349] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62d5bb6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:10:34,972 DEBUG [RS:2;jenkins-hbase17:36349] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66ea33e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-10-06 10:10:34,981 DEBUG [RS:1;jenkins-hbase17:40269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bfe9d04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:10:34,981 DEBUG [RS:1;jenkins-hbase17:40269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fc114a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-10-06 10:10:35,029 DEBUG [RS:0;jenkins-hbase17:44159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c360668, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:10:35,029 DEBUG [RS:0;jenkins-hbase17:44159] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68098f36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-10-06 10:10:35,038 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:10:35,043 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-06 10:10:35,045 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:44159 2023-10-06 10:10:35,045 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:36349 2023-10-06 10:10:35,057 INFO [RS:0;jenkins-hbase17:44159] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-06 10:10:35,089 INFO [RS:0;jenkins-hbase17:44159] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-06 10:10:35,090 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-06 10:10:35,057 INFO [RS:2;jenkins-hbase17:36349] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-06 10:10:35,097 INFO [RS:0;jenkins-hbase17:44159] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:10:35,109 INFO [RS:2;jenkins-hbase17:36349] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-06 10:10:35,109 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1022): About to register with Master. 2023-10-06 10:10:35,109 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-06 10:10:35,110 INFO [RS:2;jenkins-hbase17:36349] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:10:35,110 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1022): About to register with Master. 2023-10-06 10:10:35,112 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:40269 2023-10-06 10:10:35,113 INFO [RS:1;jenkins-hbase17:40269] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-06 10:10:35,113 INFO [RS:1;jenkins-hbase17:40269] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-06 10:10:35,113 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-06 10:10:35,113 INFO [RS:1;jenkins-hbase17:40269] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:10:35,113 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1022): About to register with Master. 2023-10-06 10:10:35,123 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45845,1696587030680 with isa=jenkins-hbase17.apache.org/136.243.18.41:40269, startcode=1696587032407 2023-10-06 10:10:35,126 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45845,1696587030680 with isa=jenkins-hbase17.apache.org/136.243.18.41:36349, startcode=1696587032478 2023-10-06 10:10:35,123 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45845,1696587030680 with isa=jenkins-hbase17.apache.org/136.243.18.41:44159, startcode=1696587032316 2023-10-06 10:10:35,163 DEBUG [RS:2;jenkins-hbase17:36349] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-06 10:10:35,164 DEBUG [RS:0;jenkins-hbase17:44159] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-06 10:10:35,165 DEBUG [RS:1;jenkins-hbase17:40269] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-06 10:10:35,251 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42105, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-06 10:10:35,251 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41739, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-06 10:10:35,251 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33653, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-06 10:10:35,259 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-06 10:10:35,272 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45845] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-06 10:10:35,275 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-10-06 10:10:35,276 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-10-06 10:10:35,276 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-10-06 10:10:35,276 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-10-06 10:10:35,276 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-10-06 10:10:35,276 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,276 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-10-06 10:10:35,276 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,284 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45845] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-06 10:10:35,285 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45845] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-06 10:10:35,310 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696587065309 2023-10-06 10:10:35,313 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-06 10:10:35,377 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-06 10:10:35,393 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(2830): Master is not running yet 2023-10-06 10:10:35,393 WARN [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-06 10:10:35,395 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(2830): Master is not running yet 2023-10-06 10:10:35,395 WARN [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-06 10:10:35,401 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(2830): Master is not running yet 2023-10-06 10:10:35,401 WARN [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-06 10:10:35,411 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-06 10:10:35,412 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-06 10:10:35,413 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-06 10:10:35,413 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-06 10:10:35,414 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,416 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-06 10:10:35,419 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-06 10:10:35,419 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-06 10:10:35,422 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-06 10:10:35,423 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-06 10:10:35,424 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-06 10:10:35,425 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-06 10:10:35,437 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1696587035430,5,FailOnTimeoutGroup] 2023-10-06 10:10:35,438 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1696587035437,5,FailOnTimeoutGroup] 2023-10-06 10:10:35,438 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,438 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-06 10:10:35,440 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,440 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,450 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-06 10:10:35,501 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45845,1696587030680 with isa=jenkins-hbase17.apache.org/136.243.18.41:36349, startcode=1696587032478 2023-10-06 10:10:35,502 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45845,1696587030680 with isa=jenkins-hbase17.apache.org/136.243.18.41:44159, startcode=1696587032316 2023-10-06 10:10:35,511 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,45845,1696587030680 with isa=jenkins-hbase17.apache.org/136.243.18.41:40269, startcode=1696587032407 2023-10-06 10:10:35,529 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45845] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:35,537 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45845] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:35,538 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45845] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:35,544 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:10:35,544 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:10:35,544 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:10:35,544 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43027 2023-10-06 10:10:35,545 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43027 2023-10-06 10:10:35,545 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-06 10:10:35,545 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43027 2023-10-06 10:10:35,545 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-06 10:10:35,551 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-06 10:10:35,553 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 10:10:35,565 DEBUG [RS:1;jenkins-hbase17:40269] zookeeper.ZKUtil(162): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:35,565 DEBUG [RS:2;jenkins-hbase17:36349] zookeeper.ZKUtil(162): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:35,566 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-06 10:10:35,568 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-06 10:10:35,565 WARN [RS:2;jenkins-hbase17:36349] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 10:10:35,565 WARN [RS:1;jenkins-hbase17:40269] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 10:10:35,568 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:10:35,570 DEBUG [RS:0;jenkins-hbase17:44159] zookeeper.ZKUtil(162): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:35,570 WARN [RS:0;jenkins-hbase17:44159] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 10:10:35,568 INFO [RS:2;jenkins-hbase17:36349] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 10:10:35,567 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,40269,1696587032407] 2023-10-06 10:10:35,572 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:35,572 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,44159,1696587032316] 2023-10-06 10:10:35,570 INFO [RS:1;jenkins-hbase17:40269] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 10:10:35,571 INFO [RS:0;jenkins-hbase17:44159] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 10:10:35,572 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:35,572 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:35,572 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,36349,1696587032478] 2023-10-06 10:10:35,621 DEBUG [RS:2;jenkins-hbase17:36349] zookeeper.ZKUtil(162): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:35,621 DEBUG [RS:0;jenkins-hbase17:44159] zookeeper.ZKUtil(162): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:35,622 DEBUG [RS:1;jenkins-hbase17:40269] zookeeper.ZKUtil(162): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:35,623 DEBUG [RS:0;jenkins-hbase17:44159] zookeeper.ZKUtil(162): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:35,623 DEBUG [RS:1;jenkins-hbase17:40269] zookeeper.ZKUtil(162): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:35,623 DEBUG [RS:2;jenkins-hbase17:36349] zookeeper.ZKUtil(162): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:35,624 DEBUG [RS:0;jenkins-hbase17:44159] zookeeper.ZKUtil(162): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:35,624 DEBUG [RS:2;jenkins-hbase17:36349] zookeeper.ZKUtil(162): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:35,625 DEBUG [RS:1;jenkins-hbase17:40269] zookeeper.ZKUtil(162): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:35,655 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-06 10:10:35,660 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:35,661 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-06 10:10:35,662 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-06 10:10:35,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-06 10:10:35,675 INFO [RS:0;jenkins-hbase17:44159] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-06 10:10:35,676 INFO [RS:2;jenkins-hbase17:36349] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-06 10:10:35,675 INFO [RS:1;jenkins-hbase17:40269] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-06 10:10:35,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/info 2023-10-06 10:10:35,679 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-06 10:10:35,680 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:35,681 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-06 10:10:35,686 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/rep_barrier 2023-10-06 10:10:35,690 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-06 10:10:35,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:35,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-06 10:10:35,695 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/table 2023-10-06 10:10:35,696 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-06 10:10:35,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:35,715 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740 2023-10-06 10:10:35,720 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740 2023-10-06 10:10:35,722 INFO [RS:1;jenkins-hbase17:40269] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-06 10:10:35,726 INFO [RS:0;jenkins-hbase17:44159] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-06 10:10:35,737 INFO [RS:0;jenkins-hbase17:44159] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-06 10:10:35,737 INFO [RS:0;jenkins-hbase17:44159] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,745 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-06 10:10:35,746 INFO [RS:1;jenkins-hbase17:40269] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-06 10:10:35,746 INFO [RS:2;jenkins-hbase17:36349] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-06 10:10:35,748 INFO [RS:2;jenkins-hbase17:36349] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-06 10:10:35,746 INFO [RS:1;jenkins-hbase17:40269] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,748 INFO [RS:2;jenkins-hbase17:36349] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,748 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-06 10:10:35,749 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-06 10:10:35,754 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-06 10:10:35,762 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-06 10:10:35,771 INFO [RS:0;jenkins-hbase17:44159] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,771 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,772 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,772 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,772 INFO [RS:1;jenkins-hbase17:40269] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,772 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,772 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,772 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,773 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:10:35,773 INFO [RS:2;jenkins-hbase17:36349] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,773 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,773 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-10-06 10:10:35,773 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,773 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,773 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-10-06 10:10:35,774 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-10-06 10:10:35,774 DEBUG [RS:1;jenkins-hbase17:40269] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,774 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69502197, jitterRate=0.03566344082355499}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-06 10:10:35,774 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,775 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-06 10:10:35,775 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,775 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,775 DEBUG [RS:0;jenkins-hbase17:44159] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,775 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,775 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-06 10:10:35,775 DEBUG [RS:2;jenkins-hbase17:36349] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-06 10:10:35,775 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-06 10:10:35,775 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-06 10:10:35,775 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-06 10:10:35,775 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-06 10:10:35,779 INFO [RS:2;jenkins-hbase17:36349] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,779 INFO [RS:2;jenkins-hbase17:36349] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,779 INFO [RS:2;jenkins-hbase17:36349] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,785 INFO [RS:0;jenkins-hbase17:44159] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,785 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-06 10:10:35,785 INFO [RS:0;jenkins-hbase17:44159] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,785 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-06 10:10:35,785 INFO [RS:0;jenkins-hbase17:44159] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,791 INFO [RS:1;jenkins-hbase17:40269] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,791 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-06 10:10:35,792 INFO [RS:1;jenkins-hbase17:40269] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,797 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-06 10:10:35,797 INFO [RS:1;jenkins-hbase17:40269] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-06 10:10:35,830 INFO [RS:2;jenkins-hbase17:36349] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-06 10:10:35,836 INFO [RS:0;jenkins-hbase17:44159] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-06 10:10:35,837 INFO [RS:1;jenkins-hbase17:40269] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-06 10:10:35,841 INFO [RS:2;jenkins-hbase17:36349] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,36349,1696587032478-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,842 INFO [RS:1;jenkins-hbase17:40269] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,40269,1696587032407-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,845 INFO [RS:0;jenkins-hbase17:44159] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44159,1696587032316-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:35,876 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-06 10:10:35,881 INFO [RS:2;jenkins-hbase17:36349] regionserver.Replication(203): jenkins-hbase17.apache.org,36349,1696587032478 started 2023-10-06 10:10:35,886 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,36349,1696587032478, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:36349, sessionid=0x1011b35d7160003 2023-10-06 10:10:35,887 DEBUG [RS:2;jenkins-hbase17:36349] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-06 10:10:35,887 DEBUG [RS:2;jenkins-hbase17:36349] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:35,887 DEBUG [RS:2;jenkins-hbase17:36349] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,36349,1696587032478' 2023-10-06 10:10:35,887 DEBUG [RS:2;jenkins-hbase17:36349] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-06 10:10:35,887 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-06 10:10:35,888 DEBUG [RS:2;jenkins-hbase17:36349] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-06 10:10:35,889 DEBUG [RS:2;jenkins-hbase17:36349] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-06 10:10:35,889 DEBUG [RS:2;jenkins-hbase17:36349] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-06 10:10:35,889 DEBUG [RS:2;jenkins-hbase17:36349] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:35,889 DEBUG [RS:2;jenkins-hbase17:36349] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,36349,1696587032478' 2023-10-06 10:10:35,889 DEBUG [RS:2;jenkins-hbase17:36349] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:35,890 DEBUG [RS:2;jenkins-hbase17:36349] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:35,891 DEBUG [RS:2;jenkins-hbase17:36349] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-06 10:10:35,892 INFO [RS:2;jenkins-hbase17:36349] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-06 10:10:35,892 INFO [RS:2;jenkins-hbase17:36349] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-06 10:10:35,896 INFO [RS:0;jenkins-hbase17:44159] regionserver.Replication(203): jenkins-hbase17.apache.org,44159,1696587032316 started 2023-10-06 10:10:35,896 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,44159,1696587032316, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:44159, sessionid=0x1011b35d7160001 2023-10-06 10:10:35,897 DEBUG [RS:0;jenkins-hbase17:44159] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-06 10:10:35,897 DEBUG [RS:0;jenkins-hbase17:44159] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:35,898 DEBUG [RS:0;jenkins-hbase17:44159] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44159,1696587032316' 2023-10-06 10:10:35,902 DEBUG [RS:0;jenkins-hbase17:44159] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-06 10:10:35,904 INFO [RS:1;jenkins-hbase17:40269] regionserver.Replication(203): jenkins-hbase17.apache.org,40269,1696587032407 started 2023-10-06 10:10:35,904 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,40269,1696587032407, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:40269, sessionid=0x1011b35d7160002 2023-10-06 10:10:35,904 DEBUG [RS:1;jenkins-hbase17:40269] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-06 10:10:35,904 DEBUG [RS:1;jenkins-hbase17:40269] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:35,904 DEBUG [RS:1;jenkins-hbase17:40269] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,40269,1696587032407' 2023-10-06 10:10:35,904 DEBUG [RS:1;jenkins-hbase17:40269] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-06 10:10:35,906 DEBUG [RS:0;jenkins-hbase17:44159] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-06 10:10:35,906 DEBUG [RS:1;jenkins-hbase17:40269] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-06 10:10:35,909 DEBUG [RS:0;jenkins-hbase17:44159] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-06 10:10:35,909 DEBUG [RS:0;jenkins-hbase17:44159] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-06 10:10:35,909 DEBUG [RS:0;jenkins-hbase17:44159] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:35,910 DEBUG [RS:0;jenkins-hbase17:44159] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44159,1696587032316' 2023-10-06 10:10:35,910 DEBUG [RS:0;jenkins-hbase17:44159] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:35,911 DEBUG [RS:1;jenkins-hbase17:40269] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-06 10:10:35,911 DEBUG [RS:1;jenkins-hbase17:40269] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-06 10:10:35,911 DEBUG [RS:1;jenkins-hbase17:40269] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:35,911 DEBUG [RS:1;jenkins-hbase17:40269] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,40269,1696587032407' 2023-10-06 10:10:35,911 DEBUG [RS:1;jenkins-hbase17:40269] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:35,913 DEBUG [RS:0;jenkins-hbase17:44159] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:35,913 DEBUG [RS:1;jenkins-hbase17:40269] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:35,914 DEBUG [RS:1;jenkins-hbase17:40269] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-06 10:10:35,914 DEBUG [RS:0;jenkins-hbase17:44159] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-06 10:10:35,915 INFO [RS:0;jenkins-hbase17:44159] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-06 10:10:35,914 INFO [RS:1;jenkins-hbase17:40269] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-06 10:10:35,915 INFO [RS:0;jenkins-hbase17:44159] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-06 10:10:35,916 INFO [RS:1;jenkins-hbase17:40269] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-06 10:10:36,009 INFO [RS:2;jenkins-hbase17:36349] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C36349%2C1696587032478, suffix=, logDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,36349,1696587032478, archiveDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/oldWALs, maxLogs=32 2023-10-06 10:10:36,022 INFO [RS:0;jenkins-hbase17:44159] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C44159%2C1696587032316, suffix=, logDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,44159,1696587032316, archiveDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/oldWALs, maxLogs=32 2023-10-06 10:10:36,033 INFO [RS:1;jenkins-hbase17:40269] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C40269%2C1696587032407, suffix=, logDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,40269,1696587032407, archiveDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/oldWALs, maxLogs=32 2023-10-06 10:10:36,048 DEBUG [jenkins-hbase17:45845] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-06 10:10:36,054 DEBUG [jenkins-hbase17:45845] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:10:36,092 DEBUG [jenkins-hbase17:45845] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:10:36,092 DEBUG [jenkins-hbase17:45845] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:10:36,092 DEBUG [jenkins-hbase17:45845] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:10:36,092 DEBUG [jenkins-hbase17:45845] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:10:36,173 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,40269,1696587032407, state=OPENING 2023-10-06 10:10:36,248 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK] 2023-10-06 10:10:36,249 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK] 2023-10-06 10:10:36,256 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK] 2023-10-06 10:10:36,256 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK] 2023-10-06 10:10:36,272 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK] 2023-10-06 10:10:36,279 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-06 10:10:36,284 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK] 2023-10-06 10:10:36,285 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK] 2023-10-06 10:10:36,286 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK] 2023-10-06 10:10:36,287 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK] 2023-10-06 10:10:36,288 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:10:36,290 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-06 10:10:36,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:10:36,338 INFO [RS:2;jenkins-hbase17:36349] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,36349,1696587032478/jenkins-hbase17.apache.org%2C36349%2C1696587032478.1696587036015 2023-10-06 10:10:36,340 INFO [RS:1;jenkins-hbase17:40269] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,40269,1696587032407/jenkins-hbase17.apache.org%2C40269%2C1696587032407.1696587036035 2023-10-06 10:10:36,340 INFO [RS:0;jenkins-hbase17:44159] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,44159,1696587032316/jenkins-hbase17.apache.org%2C44159%2C1696587032316.1696587036026 2023-10-06 10:10:36,345 DEBUG [RS:2;jenkins-hbase17:36349] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK], DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK], DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK]] 2023-10-06 10:10:36,353 DEBUG [RS:0;jenkins-hbase17:44159] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK], DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK], DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK]] 2023-10-06 10:10:36,357 DEBUG [RS:1;jenkins-hbase17:40269] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK], DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK], DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK]] 2023-10-06 10:10:36,540 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:36,543 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 10:10:36,552 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 10:10:36,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-06 10:10:36,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 10:10:36,625 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C40269%2C1696587032407.meta, suffix=.meta, logDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,40269,1696587032407, archiveDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/oldWALs, maxLogs=32 2023-10-06 10:10:36,666 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK] 2023-10-06 10:10:36,667 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK] 2023-10-06 10:10:36,686 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK] 2023-10-06 10:10:36,695 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,40269,1696587032407/jenkins-hbase17.apache.org%2C40269%2C1696587032407.meta.1696587036627.meta 2023-10-06 10:10:36,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37489,DS-7075a85b-2ffd-4d2e-bac5-4f2607c14827,DISK], DatanodeInfoWithStorage[127.0.0.1:34543,DS-7533057a-e999-44d3-8d0e-e3183c3ee809,DISK], DatanodeInfoWithStorage[127.0.0.1:34205,DS-611c0db4-c3a0-448e-a959-feefea02e0ba,DISK]] 2023-10-06 10:10:36,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-06 10:10:36,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-06 10:10:36,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:10:36,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-06 10:10:36,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-06 10:10:36,705 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-06 10:10:36,738 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-06 10:10:36,738 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:36,738 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-06 10:10:36,738 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-06 10:10:36,745 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-06 10:10:36,749 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/info 2023-10-06 10:10:36,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/info 2023-10-06 10:10:36,762 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-06 10:10:36,770 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:36,770 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-06 10:10:36,777 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/rep_barrier 2023-10-06 10:10:36,778 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/rep_barrier 2023-10-06 10:10:36,783 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-06 10:10:36,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:36,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-06 10:10:36,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/table 2023-10-06 10:10:36,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/table 2023-10-06 10:10:36,795 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-06 10:10:36,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:36,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740 2023-10-06 10:10:36,814 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740 2023-10-06 10:10:36,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-06 10:10:36,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-06 10:10:36,873 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71321128, jitterRate=0.0627676248550415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-06 10:10:36,877 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-06 10:10:36,923 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696587036529 2023-10-06 10:10:36,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-06 10:10:36,990 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-06 10:10:36,997 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,40269,1696587032407, state=OPEN 2023-10-06 10:10:37,001 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-06 10:10:37,001 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-06 10:10:37,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-06 10:10:37,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,40269,1696587032407 in 705 msec 2023-10-06 10:10:37,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-06 10:10:37,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.2060 sec 2023-10-06 10:10:37,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.9330 sec 2023-10-06 10:10:37,061 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696587037061, completionTime=-1 2023-10-06 10:10:37,061 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-06 10:10:37,061 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-06 10:10:37,186 DEBUG [hconnection-0x4ec58b09-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:37,196 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:37,235 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-06 10:10:37,235 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696587097235 2023-10-06 10:10:37,235 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696587157235 2023-10-06 10:10:37,235 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 173 msec 2023-10-06 10:10:37,295 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45845,1696587030680-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:37,296 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45845,1696587030680-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:37,296 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45845,1696587030680-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:37,299 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:45845, period=300000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:37,300 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-06 10:10:37,328 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-06 10:10:37,333 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-06 10:10:37,335 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-06 10:10:37,357 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-06 10:10:37,365 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 10:10:37,391 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 10:10:37,417 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:10:37,420 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670 empty. 2023-10-06 10:10:37,423 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:10:37,425 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-06 10:10:37,591 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-06 10:10:37,602 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4276fc4bac3c2b6c02ad86b156998670, NAME => 'hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:10:37,644 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:37,644 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4276fc4bac3c2b6c02ad86b156998670, disabling compactions & flushes 2023-10-06 10:10:37,644 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:10:37,644 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:10:37,644 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. after waiting 0 ms 2023-10-06 10:10:37,644 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:10:37,644 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:10:37,644 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4276fc4bac3c2b6c02ad86b156998670: 2023-10-06 10:10:37,652 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 10:10:37,676 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696587037656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587037656"}]},"ts":"1696587037656"} 2023-10-06 10:10:37,715 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-06 10:10:37,720 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 10:10:37,726 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587037720"}]},"ts":"1696587037720"} 2023-10-06 10:10:37,733 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-06 10:10:37,743 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:10:37,746 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:10:37,746 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:10:37,746 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:10:37,746 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:10:37,750 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4276fc4bac3c2b6c02ad86b156998670, ASSIGN}] 2023-10-06 10:10:37,755 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4276fc4bac3c2b6c02ad86b156998670, ASSIGN 2023-10-06 10:10:37,758 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4276fc4bac3c2b6c02ad86b156998670, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36349,1696587032478; forceNewPlan=false, retain=false 2023-10-06 10:10:37,911 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-06 10:10:37,913 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4276fc4bac3c2b6c02ad86b156998670, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:37,914 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696587037913"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587037913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587037913"}]},"ts":"1696587037913"} 2023-10-06 10:10:37,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4276fc4bac3c2b6c02ad86b156998670, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:10:38,097 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:38,098 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 10:10:38,105 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 10:10:38,129 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:10:38,129 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4276fc4bac3c2b6c02ad86b156998670, NAME => 'hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670.', STARTKEY => '', ENDKEY => ''} 2023-10-06 10:10:38,130 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. service=AccessControlService 2023-10-06 10:10:38,133 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:10:38,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:10:38,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:38,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:10:38,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:10:38,161 INFO [StoreOpener-4276fc4bac3c2b6c02ad86b156998670-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:10:38,181 DEBUG [StoreOpener-4276fc4bac3c2b6c02ad86b156998670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670/info 2023-10-06 10:10:38,182 DEBUG [StoreOpener-4276fc4bac3c2b6c02ad86b156998670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670/info 2023-10-06 10:10:38,182 INFO [StoreOpener-4276fc4bac3c2b6c02ad86b156998670-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4276fc4bac3c2b6c02ad86b156998670 columnFamilyName info 2023-10-06 10:10:38,186 INFO [StoreOpener-4276fc4bac3c2b6c02ad86b156998670-1] regionserver.HStore(310): Store=4276fc4bac3c2b6c02ad86b156998670/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:38,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:10:38,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:10:38,249 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:10:38,294 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:10:38,297 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4276fc4bac3c2b6c02ad86b156998670; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64784531, jitterRate=-0.034635260701179504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:10:38,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4276fc4bac3c2b6c02ad86b156998670: 2023-10-06 10:10:38,309 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670., pid=6, masterSystemTime=1696587038097 2023-10-06 10:10:38,326 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:10:38,328 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:10:38,334 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4276fc4bac3c2b6c02ad86b156998670, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:38,335 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696587038334"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587038334"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587038334"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587038334"}]},"ts":"1696587038334"} 2023-10-06 10:10:38,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-06 10:10:38,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4276fc4bac3c2b6c02ad86b156998670, server=jenkins-hbase17.apache.org,36349,1696587032478 in 438 msec 2023-10-06 10:10:38,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-06 10:10:38,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4276fc4bac3c2b6c02ad86b156998670, ASSIGN in 656 msec 2023-10-06 10:10:38,440 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 10:10:38,440 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587038440"}]},"ts":"1696587038440"} 2023-10-06 10:10:38,450 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-06 10:10:38,470 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 10:10:38,475 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-06 10:10:38,485 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-06 10:10:38,486 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:10:38,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.1340 sec 2023-10-06 10:10:38,540 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:38,549 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:38,589 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-06 10:10:38,641 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-06 10:10:38,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 110 msec 2023-10-06 10:10:38,683 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-06 10:10:38,710 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-06 10:10:38,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 35 msec 2023-10-06 10:10:38,739 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-06 10:10:38,743 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-06 10:10:38,743 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 5.735sec 2023-10-06 10:10:38,747 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-06 10:10:38,750 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-06 10:10:38,750 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-06 10:10:38,753 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45845,1696587030680-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-06 10:10:38,754 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45845,1696587030680-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-06 10:10:38,779 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-06 10:10:38,788 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-06 10:10:38,792 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 10:10:38,796 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 10:10:38,799 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-06 10:10:38,801 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:10:38,802 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50 empty. 2023-10-06 10:10:38,812 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 10:10:38,813 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:10:38,813 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-06 10:10:38,819 DEBUG [Listener at localhost/42741] zookeeper.ReadOnlyZKClient(139): Connect 0x4423e4e4 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:10:38,868 DEBUG [Listener at localhost/42741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bd4066d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:10:38,916 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-06 10:10:38,917 DEBUG [hconnection-0x505f8408-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:38,918 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 10:10:38,919 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9173fcba91788b7e6bc21028bb748f50, NAME => 'hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:10:38,954 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:38,962 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:10:38,966 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-06 10:10:38,967 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/test.cache.data in system properties and HBase conf 2023-10-06 10:10:38,967 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop.tmp.dir in system properties and HBase conf 2023-10-06 10:10:38,967 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop.log.dir in system properties and HBase conf 2023-10-06 10:10:38,967 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-06 10:10:38,967 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-06 10:10:38,967 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-06 10:10:38,968 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-06 10:10:38,968 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-06 10:10:38,968 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-06 10:10:38,968 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 10:10:38,968 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-06 10:10:38,968 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-06 10:10:38,968 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 10:10:38,969 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 10:10:38,969 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-06 10:10:38,969 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/nfs.dump.dir in system properties and HBase conf 2023-10-06 10:10:38,969 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir in system properties and HBase conf 2023-10-06 10:10:38,970 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 10:10:38,970 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-06 10:10:38,970 INFO [Listener at localhost/42741] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-06 10:10:39,040 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:39,040 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 9173fcba91788b7e6bc21028bb748f50, disabling compactions & flushes 2023-10-06 10:10:39,040 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:10:39,040 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:10:39,040 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. after waiting 0 ms 2023-10-06 10:10:39,040 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:10:39,041 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:10:39,041 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 9173fcba91788b7e6bc21028bb748f50: 2023-10-06 10:10:39,078 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 10:10:39,081 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696587039080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587039080"}]},"ts":"1696587039080"} 2023-10-06 10:10:39,101 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-06 10:10:39,118 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 10:10:39,122 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 10:10:39,122 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587039122"}]},"ts":"1696587039122"} 2023-10-06 10:10:39,145 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-06 10:10:39,153 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:10:39,157 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:10:39,162 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:10:39,162 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:10:39,162 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:10:39,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9173fcba91788b7e6bc21028bb748f50, ASSIGN}] 2023-10-06 10:10:39,170 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9173fcba91788b7e6bc21028bb748f50, ASSIGN 2023-10-06 10:10:39,188 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=9173fcba91788b7e6bc21028bb748f50, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44159,1696587032316; forceNewPlan=false, retain=false 2023-10-06 10:10:39,339 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-06 10:10:39,341 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9173fcba91788b7e6bc21028bb748f50, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:39,342 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696587039341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587039341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587039341"}]},"ts":"1696587039341"} 2023-10-06 10:10:39,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 9173fcba91788b7e6bc21028bb748f50, server=jenkins-hbase17.apache.org,44159,1696587032316}] 2023-10-06 10:10:39,421 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 10:10:39,521 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:39,522 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 10:10:39,529 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 10:10:39,549 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:10:39,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9173fcba91788b7e6bc21028bb748f50, NAME => 'hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50.', STARTKEY => '', ENDKEY => ''} 2023-10-06 10:10:39,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. service=AccessControlService 2023-10-06 10:10:39,551 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:10:39,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:10:39,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:39,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:10:39,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:10:39,557 INFO [StoreOpener-9173fcba91788b7e6bc21028bb748f50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:10:39,563 DEBUG [StoreOpener-9173fcba91788b7e6bc21028bb748f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50/l 2023-10-06 10:10:39,563 DEBUG [StoreOpener-9173fcba91788b7e6bc21028bb748f50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50/l 2023-10-06 10:10:39,564 INFO [StoreOpener-9173fcba91788b7e6bc21028bb748f50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9173fcba91788b7e6bc21028bb748f50 columnFamilyName l 2023-10-06 10:10:39,569 INFO [StoreOpener-9173fcba91788b7e6bc21028bb748f50-1] regionserver.HStore(310): Store=9173fcba91788b7e6bc21028bb748f50/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:39,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:10:39,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:10:39,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:10:39,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:10:39,636 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 9173fcba91788b7e6bc21028bb748f50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69709696, jitterRate=0.03875541687011719}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:10:39,636 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 9173fcba91788b7e6bc21028bb748f50: 2023-10-06 10:10:39,645 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50., pid=11, masterSystemTime=1696587039521 2023-10-06 10:10:39,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:10:39,663 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:10:39,666 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9173fcba91788b7e6bc21028bb748f50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:39,666 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696587039665"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587039665"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587039665"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587039665"}]},"ts":"1696587039665"} 2023-10-06 10:10:39,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-06 10:10:39,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 9173fcba91788b7e6bc21028bb748f50, server=jenkins-hbase17.apache.org,44159,1696587032316 in 320 msec 2023-10-06 10:10:39,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-06 10:10:39,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=9173fcba91788b7e6bc21028bb748f50, ASSIGN in 513 msec 2023-10-06 10:10:39,689 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 10:10:39,689 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587039689"}]},"ts":"1696587039689"} 2023-10-06 10:10:39,694 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-06 10:10:39,704 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 10:10:39,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 924 msec 2023-10-06 10:10:39,921 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 10:10:39,921 INFO [master/jenkins-hbase17:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-06 10:10:39,939 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-06 10:10:40,908 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:10:40,909 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-06 10:10:40,910 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:10:40,910 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-06 10:10:40,910 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-06 10:10:40,910 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-06 10:10:40,910 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:10:40,910 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-06 10:10:40,911 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-06 10:10:40,911 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-06 10:10:41,098 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 10:10:41,614 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 10:10:41,629 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_39259_jobhistory____.ge1y4b/webapp 2023-10-06 10:10:41,665 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-06 10:10:41,667 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-06 10:10:41,668 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-06 10:10:41,961 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-06 10:10:41,961 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-06 10:10:41,961 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 10:10:41,965 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 10:10:42,065 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:42,409 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 10:10:42,616 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:43,060 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-06 10:10:43,389 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:39259 2023-10-06 10:10:44,086 WARN [Listener at jenkins-hbase17.apache.org/43411] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 10:10:44,237 WARN [Listener at jenkins-hbase17.apache.org/43411] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-06 10:10:44,238 INFO [Listener at jenkins-hbase17.apache.org/43411] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 10:10:44,256 INFO [Listener at jenkins-hbase17.apache.org/43411] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_33543_cluster____8bo3c4/webapp 2023-10-06 10:10:44,406 INFO [Listener at jenkins-hbase17.apache.org/43411] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-06 10:10:44,406 INFO [Listener at jenkins-hbase17.apache.org/43411] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-06 10:10:44,406 INFO [Listener at jenkins-hbase17.apache.org/43411] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 10:10:44,407 INFO [Listener at jenkins-hbase17.apache.org/43411] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 10:10:44,427 INFO [Listener at jenkins-hbase17.apache.org/43411] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:44,843 INFO [Listener at jenkins-hbase17.apache.org/43411] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:45,003 INFO [Listener at jenkins-hbase17.apache.org/43411] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:45,036 INFO [Listener at jenkins-hbase17.apache.org/43411] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:33543 2023-10-06 10:10:46,036 WARN [Listener at jenkins-hbase17.apache.org/32955] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 10:10:46,071 WARN [Listener at jenkins-hbase17.apache.org/32955] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-06 10:10:46,071 INFO [Listener at jenkins-hbase17.apache.org/32955] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 10:10:46,081 INFO [Listener at jenkins-hbase17.apache.org/32955] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_39191_node____.ahd643/webapp 2023-10-06 10:10:46,150 INFO [Listener at jenkins-hbase17.apache.org/32955] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-06 10:10:46,150 INFO [Listener at jenkins-hbase17.apache.org/32955] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 10:10:46,150 INFO [Listener at jenkins-hbase17.apache.org/32955] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-06 10:10:46,150 INFO [Listener at jenkins-hbase17.apache.org/32955] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 10:10:46,165 INFO [Listener at jenkins-hbase17.apache.org/32955] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:46,193 INFO [Listener at jenkins-hbase17.apache.org/32955] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:46,293 INFO [Listener at jenkins-hbase17.apache.org/32955] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:46,333 INFO [Listener at jenkins-hbase17.apache.org/32955] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:39191 2023-10-06 10:10:46,929 WARN [Listener at jenkins-hbase17.apache.org/42055] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 10:10:46,942 WARN [Listener at jenkins-hbase17.apache.org/42055] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-06 10:10:46,943 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 10:10:46,972 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_33613_node____7fc0o2/webapp 2023-10-06 10:10:47,038 INFO [Listener at jenkins-hbase17.apache.org/42055] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-06 10:10:47,038 INFO [Listener at jenkins-hbase17.apache.org/42055] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 10:10:47,038 INFO [Listener at jenkins-hbase17.apache.org/42055] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-06 10:10:47,038 INFO [Listener at jenkins-hbase17.apache.org/42055] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 10:10:47,056 INFO [Listener at jenkins-hbase17.apache.org/42055] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:47,091 INFO [Listener at jenkins-hbase17.apache.org/42055] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:47,210 INFO [Listener at jenkins-hbase17.apache.org/42055] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 10:10:47,219 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:33613 2023-10-06 10:10:47,259 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-06 10:10:47,260 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:10:47,383 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=938, ProcessCount=189, AvailableMemoryMB=3893 2023-10-06 10:10:47,383 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-10-06 10:10:47,414 DEBUG [Listener at jenkins-hbase17.apache.org/42055] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-06 10:10:47,422 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-06 10:10:47,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 10:10:47,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-06 10:10:47,439 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 10:10:47,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-06 10:10:47,443 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 10:10:47,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 10:10:47,450 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:10:47,451 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869 empty. 2023-10-06 10:10:47,452 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:10:47,453 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:10:47,454 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b empty. 2023-10-06 10:10:47,454 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:10:47,454 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-06 10:10:47,502 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-06 10:10:47,504 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 82eee9dd7da54e3b41f49ff7607ed46b, NAME => 'testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:10:47,513 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 29e089d3fe6881a2adbc1ded58a4f869, NAME => 'testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:10:47,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 10:10:47,595 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:47,596 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 82eee9dd7da54e3b41f49ff7607ed46b, disabling compactions & flushes 2023-10-06 10:10:47,597 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:47,597 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:47,597 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. after waiting 0 ms 2023-10-06 10:10:47,597 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:47,597 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:47,597 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 82eee9dd7da54e3b41f49ff7607ed46b: 2023-10-06 10:10:47,615 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:47,615 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 29e089d3fe6881a2adbc1ded58a4f869, disabling compactions & flushes 2023-10-06 10:10:47,615 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:47,615 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:47,615 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. after waiting 0 ms 2023-10-06 10:10:47,615 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:47,615 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:47,615 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 29e089d3fe6881a2adbc1ded58a4f869: 2023-10-06 10:10:47,620 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 10:10:47,626 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587047625"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587047625"}]},"ts":"1696587047625"} 2023-10-06 10:10:47,626 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587047625"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587047625"}]},"ts":"1696587047625"} 2023-10-06 10:10:47,693 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 10:10:47,697 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 10:10:47,698 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587047697"}]},"ts":"1696587047697"} 2023-10-06 10:10:47,701 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-06 10:10:47,724 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:10:47,726 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:10:47,726 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:10:47,726 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:10:47,726 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:10:47,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=29e089d3fe6881a2adbc1ded58a4f869, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=82eee9dd7da54e3b41f49ff7607ed46b, ASSIGN}] 2023-10-06 10:10:47,736 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=82eee9dd7da54e3b41f49ff7607ed46b, ASSIGN 2023-10-06 10:10:47,737 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=29e089d3fe6881a2adbc1ded58a4f869, ASSIGN 2023-10-06 10:10:47,739 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=29e089d3fe6881a2adbc1ded58a4f869, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36349,1696587032478; forceNewPlan=false, retain=false 2023-10-06 10:10:47,739 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=82eee9dd7da54e3b41f49ff7607ed46b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44159,1696587032316; forceNewPlan=false, retain=false 2023-10-06 10:10:47,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 10:10:47,890 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 10:10:47,892 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=82eee9dd7da54e3b41f49ff7607ed46b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:47,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=29e089d3fe6881a2adbc1ded58a4f869, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:47,893 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587047892"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587047892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587047892"}]},"ts":"1696587047892"} 2023-10-06 10:10:47,893 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587047892"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587047892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587047892"}]},"ts":"1696587047892"} 2023-10-06 10:10:47,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 82eee9dd7da54e3b41f49ff7607ed46b, server=jenkins-hbase17.apache.org,44159,1696587032316}] 2023-10-06 10:10:47,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 29e089d3fe6881a2adbc1ded58a4f869, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:10:48,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 10:10:48,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:48,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82eee9dd7da54e3b41f49ff7607ed46b, NAME => 'testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 10:10:48,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. service=AccessControlService 2023-10-06 10:10:48,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:10:48,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:10:48,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:48,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:10:48,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:10:48,081 INFO [StoreOpener-82eee9dd7da54e3b41f49ff7607ed46b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:10:48,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:48,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 29e089d3fe6881a2adbc1ded58a4f869, NAME => 'testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 10:10:48,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. service=AccessControlService 2023-10-06 10:10:48,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:10:48,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:10:48,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:10:48,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:10:48,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:10:48,084 DEBUG [StoreOpener-82eee9dd7da54e3b41f49ff7607ed46b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/cf 2023-10-06 10:10:48,084 DEBUG [StoreOpener-82eee9dd7da54e3b41f49ff7607ed46b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/cf 2023-10-06 10:10:48,089 INFO [StoreOpener-82eee9dd7da54e3b41f49ff7607ed46b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82eee9dd7da54e3b41f49ff7607ed46b columnFamilyName cf 2023-10-06 10:10:48,092 INFO [StoreOpener-82eee9dd7da54e3b41f49ff7607ed46b-1] regionserver.HStore(310): Store=82eee9dd7da54e3b41f49ff7607ed46b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:48,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:10:48,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:10:48,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:10:48,113 INFO [StoreOpener-29e089d3fe6881a2adbc1ded58a4f869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:10:48,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:10:48,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 82eee9dd7da54e3b41f49ff7607ed46b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59038070, jitterRate=-0.1202642023563385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:10:48,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 82eee9dd7da54e3b41f49ff7607ed46b: 2023-10-06 10:10:48,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b., pid=15, masterSystemTime=1696587048068 2023-10-06 10:10:48,119 DEBUG [StoreOpener-29e089d3fe6881a2adbc1ded58a4f869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/cf 2023-10-06 10:10:48,119 DEBUG [StoreOpener-29e089d3fe6881a2adbc1ded58a4f869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/cf 2023-10-06 10:10:48,120 INFO [StoreOpener-29e089d3fe6881a2adbc1ded58a4f869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29e089d3fe6881a2adbc1ded58a4f869 columnFamilyName cf 2023-10-06 10:10:48,122 INFO [StoreOpener-29e089d3fe6881a2adbc1ded58a4f869-1] regionserver.HStore(310): Store=29e089d3fe6881a2adbc1ded58a4f869/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:10:48,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:48,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:48,126 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=82eee9dd7da54e3b41f49ff7607ed46b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:48,127 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587048126"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587048126"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587048126"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587048126"}]},"ts":"1696587048126"} 2023-10-06 10:10:48,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:10:48,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:10:48,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:10:48,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:10:48,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 29e089d3fe6881a2adbc1ded58a4f869; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69295477, jitterRate=0.032583072781562805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:10:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 29e089d3fe6881a2adbc1ded58a4f869: 2023-10-06 10:10:48,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-06 10:10:48,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 82eee9dd7da54e3b41f49ff7607ed46b, server=jenkins-hbase17.apache.org,44159,1696587032316 in 242 msec 2023-10-06 10:10:48,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=82eee9dd7da54e3b41f49ff7607ed46b, ASSIGN in 420 msec 2023-10-06 10:10:48,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869., pid=16, masterSystemTime=1696587048068 2023-10-06 10:10:48,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:48,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:48,158 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=29e089d3fe6881a2adbc1ded58a4f869, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:48,158 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587048157"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587048157"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587048157"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587048157"}]},"ts":"1696587048157"} 2023-10-06 10:10:48,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-06 10:10:48,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 29e089d3fe6881a2adbc1ded58a4f869, server=jenkins-hbase17.apache.org,36349,1696587032478 in 273 msec 2023-10-06 10:10:48,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-10-06 10:10:48,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=29e089d3fe6881a2adbc1ded58a4f869, ASSIGN in 456 msec 2023-10-06 10:10:48,197 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 10:10:48,203 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587048202"}]},"ts":"1696587048202"} 2023-10-06 10:10:48,206 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-06 10:10:48,209 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 10:10:48,216 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-06 10:10:48,231 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:48,237 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:48,255 DEBUG [hconnection-0x4c82953a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:48,260 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-10-06 10:10:48,280 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-06 10:10:48,322 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 10:10:48,324 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 10:10:48,325 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:10:48,325 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 10:10:48,336 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 10:10:48,349 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 10:10:48,349 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 10:10:48,353 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 10:10:48,353 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 10:10:48,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 919 msec 2023-10-06 10:10:48,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 10:10:48,560 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-06 10:10:48,585 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-06 10:10:48,586 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:48,593 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:10:48,653 DEBUG [hconnection-0x505f8408-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:48,692 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:48,699 DEBUG [hconnection-0x505f8408-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:48,706 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:48,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 10:10:48,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587048741 (current time:1696587048741). 2023-10-06 10:10:48,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:10:48,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x254c4f8a to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:10:48,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28619534, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:10:48,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:48,789 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:48,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x254c4f8a to 127.0.0.1:65169 2023-10-06 10:10:48,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:10:48,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x1b669b19 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:10:48,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d553380, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:10:48,931 DEBUG [hconnection-0xf311f90-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:48,936 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:48,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:48,954 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:48,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b669b19 to 127.0.0.1:65169 2023-10-06 10:10:48,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:10:48,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-06 10:10:48,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:10:48,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 10:10:49,023 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:10:49,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 10:10:49,065 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 10:10:49,069 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696587649069 2023-10-06 10:10:49,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 10:10:49,083 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-06 10:10:49,101 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 10:10:49,114 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:10:49,114 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:10:49,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 10:10:49,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 62 msec 2023-10-06 10:10:49,153 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 10:10:49,162 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696587649162 2023-10-06 10:10:49,215 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:49,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:49,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:10:49,237 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:10:49,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,337 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-06 10:10:49,337 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:10:49,337 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-06 10:10:49,337 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-06 10:10:49,340 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,341 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,353 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:49,353 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:49,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:49,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:49,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:49,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:49,353 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:49,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:49,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:49,354 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,358 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,358 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-06 10:10:49,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,359 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:49,359 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:10:49,359 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 10:10:49,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-06 10:10:49,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-06 10:10:49,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 10:10:49,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,377 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 10:10:49,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,385 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 10:10:49,401 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:10:49,397 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 10:10:49,402 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:10:49,389 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 10:10:49,402 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:10:49,403 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 10:10:49,404 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-06 10:10:49,404 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-06 10:10:49,409 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 10:10:49,409 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-06 10:10:49,409 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-06 10:10:49,409 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 10:10:49,409 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-06 10:10:49,409 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-06 10:10:49,412 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:49,412 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,412 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,412 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:10:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:49,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:49,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:49,418 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:49,425 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:49,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,428 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:49,429 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:49,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-06 10:10:49,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a0c542e[Count = 1] remaining members to acquire global barrier 2023-10-06 10:10:49,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:49,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:49,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:49,430 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,430 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:10:49,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:49,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:49,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:49,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:49,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-06 10:10:49,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a0c542e[Count = 0] remaining members to acquire global barrier 2023-10-06 10:10:49,429 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:10:49,433 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-06 10:10:49,433 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,435 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,436 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,436 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,436 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 10:10:49,436 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:49,437 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,437 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:10:49,437 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 10:10:49,437 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-06 10:10:49,437 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:10:49,437 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:49,440 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 10:10:49,461 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 10:10:49,461 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:49,461 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. started... 2023-10-06 10:10:49,461 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:10:49,462 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:10:49,464 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 29e089d3fe6881a2adbc1ded58a4f869: 2023-10-06 10:10:49,461 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:10:49,465 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-06 10:10:49,465 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,465 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:10:49,489 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:10:49,488 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:49,493 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. started... 2023-10-06 10:10:49,496 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:10:49,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:49,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:10:49,501 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:10:49,509 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:10:49,510 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 82eee9dd7da54e3b41f49ff7607ed46b: 2023-10-06 10:10:49,510 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,510 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:10:49,510 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:10:49,679 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. completed. 2023-10-06 10:10:49,679 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:49,680 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:10:49,680 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:10:49,680 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,680 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-06 10:10:49,680 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:10:49,686 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 10:10:49,686 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:49,686 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:10:49,687 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-06 10:10:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:49,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:49,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:49,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:49,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:49,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,44159,1696587032316': 2023-10-06 10:10:49,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-06 10:10:49,809 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:49,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:49,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:10:49,812 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-06 10:10:50,067 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. completed. 2023-10-06 10:10:50,067 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:50,067 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:10:50,067 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:10:50,067 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,067 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-06 10:10:50,067 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:10:50,069 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 10:10:50,069 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:10:50,069 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-06 10:10:50,071 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:50,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:50,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:50,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:50,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:50,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:50,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:50,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:50,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,36349,1696587032478': 2023-10-06 10:10:50,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-06 10:10:50,079 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-06 10:10:50,079 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:10:50,079 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:10:50,079 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,079 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:10:50,082 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,082 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,082 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:50,082 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,083 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,082 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:50,083 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:50,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:50,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:50,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:50,084 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:50,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:50,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:50,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:50,085 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:50,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,086 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:50,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:50,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:50,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,088 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:50,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:50,089 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:50,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,089 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:50,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:50,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,138 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:50,138 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:50,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:50,138 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:50,138 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:50,138 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:50,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:50,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,139 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:10:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:50,138 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:50,158 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,165 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-06 10:10:50,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:10:50,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:50,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:50,139 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:50,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 10:10:50,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,312 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:50,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:50,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:10:50,314 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-06 10:10:50,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-06 10:10:50,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,447 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-06 10:10:50,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696587049083Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696587050301 (+1218 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696587050301Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696587050301Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696587050323 (+22 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696587050401 (+78 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696587050444 (+43 ms) 2023-10-06 10:10:50,453 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 10:10:50,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.3600 sec 2023-10-06 10:10:51,314 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:51,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:51,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:10:51,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:10:51,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44159] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:10:51,365 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-06 10:10:51,365 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:51,365 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:10:51,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 10:10:51,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587051421 (current time:1696587051421). 2023-10-06 10:10:51,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:10:51,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x7bc0448f to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:10:51,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@605eb318, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:10:51,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:51,471 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:51,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bc0448f to 127.0.0.1:65169 2023-10-06 10:10:51,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:10:51,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x2dc42c38 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:10:51,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5459f133, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:10:51,565 DEBUG [hconnection-0x418a4ed3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:51,569 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:51,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:10:51,583 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:10:51,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2dc42c38 to 127.0.0.1:65169 2023-10-06 10:10:51,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:10:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-06 10:10:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:10:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 10:10:51,593 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:10:51,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 10:10:51,610 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 10:10:51,621 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696587651621 2023-10-06 10:10:51,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 10:10:51,622 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-06 10:10:51,625 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:10:51,626 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:10:51,629 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 10:10:51,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 10:10:51,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 33 msec 2023-10-06 10:10:51,645 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 10:10:51,651 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696587651651 2023-10-06 10:10:51,729 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:51,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:51,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:10:51,738 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:10:51,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-06 10:10:51,783 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-06 10:10:51,783 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:10:51,783 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-06 10:10:51,783 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-06 10:10:51,784 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,784 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,789 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:51,789 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:51,789 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:51,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:51,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:51,790 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:51,790 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:51,790 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:51,790 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:10:51,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,793 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:51,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:51,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-06 10:10:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 10:10:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-06 10:10:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 10:10:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-06 10:10:51,794 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 10:10:51,794 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:10:51,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-06 10:10:51,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,796 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 10:10:51,796 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:10:51,796 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 10:10:51,796 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-06 10:10:51,796 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-06 10:10:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-06 10:10:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,798 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 10:10:51,798 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-06 10:10:51,798 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-06 10:10:51,798 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 10:10:51,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-06 10:10:51,801 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 10:10:51,806 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:10:51,807 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,808 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,808 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,808 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:10:51,808 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,808 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:10:51,809 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 10:10:51,809 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-06 10:10:51,809 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-06 10:10:51,809 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:51,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:51,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:51,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:51,810 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,810 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,810 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:10:51,811 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:51,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:51,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:51,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 10:10:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:51,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:51,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-06 10:10:51,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@296b63ab[Count = 1] remaining members to acquire global barrier 2023-10-06 10:10:51,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:51,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:51,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:51,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:51,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:51,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 10:10:51,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:51,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:51,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:51,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-06 10:10:51,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@296b63ab[Count = 0] remaining members to acquire global barrier 2023-10-06 10:10:51,827 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-06 10:10:51,827 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,830 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,830 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,830 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 10:10:51,830 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:51,831 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 10:10:51,831 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-06 10:10:51,831 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:10:51,831 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:10:51,831 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:10:51,831 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 10:10:51,831 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:51,831 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. started... 2023-10-06 10:10:51,831 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 29e089d3fe6881a2adbc1ded58a4f869 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-06 10:10:51,832 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:51,838 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:10:51,838 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:10:51,838 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:51,838 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. started... 2023-10-06 10:10:51,839 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 82eee9dd7da54e3b41f49ff7607ed46b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-06 10:10:51,842 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 10:10:51,842 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:10:51,842 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-06 10:10:51,842 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:51,842 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:10:51,941 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:51,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:51,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:10:51,959 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:10:52,086 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100635b19c856718490999bbf08f80355d6a to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100635b19c856718490999bbf08f80355d6a 2023-10-06 10:10:52,086 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006dbf1bb6ae23248bda169ef1d8fc78a3e to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006dbf1bb6ae23248bda169ef1d8fc78a3e 2023-10-06 10:10:52,175 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/.tmp/cf/1a64a44699a1485eb1ffa56706d62fd9 2023-10-06 10:10:52,195 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/.tmp/cf/1a64a44699a1485eb1ffa56706d62fd9 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/cf/1a64a44699a1485eb1ffa56706d62fd9 2023-10-06 10:10:52,214 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/cf/1a64a44699a1485eb1ffa56706d62fd9, entries=46, sequenceid=6, filesize=12.6 K 2023-10-06 10:10:52,217 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 82eee9dd7da54e3b41f49ff7607ed46b in 378ms, sequenceid=6, compaction requested=false 2023-10-06 10:10:52,218 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-06 10:10:52,219 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 82eee9dd7da54e3b41f49ff7607ed46b: 2023-10-06 10:10:52,219 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-06 10:10:52,220 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:10:52,220 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/cf/1a64a44699a1485eb1ffa56706d62fd9] hfiles 2023-10-06 10:10:52,220 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/cf/1a64a44699a1485eb1ffa56706d62fd9 for snapshot=snaptb0-testExportWithTargetName 2023-10-06 10:10:52,260 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:52,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:52,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:10:52,270 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-06 10:10:52,545 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/.tmp/cf/84723f240c4641e58ed6ecae5be596a3 2023-10-06 10:10:52,556 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/.tmp/cf/84723f240c4641e58ed6ecae5be596a3 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/cf/84723f240c4641e58ed6ecae5be596a3 2023-10-06 10:10:52,575 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/cf/84723f240c4641e58ed6ecae5be596a3, entries=4, sequenceid=6, filesize=5.6 K 2023-10-06 10:10:52,578 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 29e089d3fe6881a2adbc1ded58a4f869 in 747ms, sequenceid=6, compaction requested=false 2023-10-06 10:10:52,580 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 29e089d3fe6881a2adbc1ded58a4f869: 2023-10-06 10:10:52,580 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-06 10:10:52,580 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:10:52,580 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/cf/84723f240c4641e58ed6ecae5be596a3] hfiles 2023-10-06 10:10:52,580 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/cf/84723f240c4641e58ed6ecae5be596a3 for snapshot=snaptb0-testExportWithTargetName 2023-10-06 10:10:52,617 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. completed. 2023-10-06 10:10:52,617 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:10:52,619 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:10:52,621 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:10:52,621 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,621 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-06 10:10:52,621 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:10:52,629 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 10:10:52,629 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:10:52,629 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-06 10:10:52,629 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:52,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:52,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:52,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:52,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 10:10:52,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 10:10:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,36349,1696587032478': 2023-10-06 10:10:52,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-06 10:10:52,673 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. completed. 2023-10-06 10:10:52,673 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:10:52,675 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:10:52,675 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:10:52,675 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,675 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-06 10:10:52,675 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:10:52,678 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,678 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 10:10:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:52,678 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:10:52,678 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-06 10:10:52,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:52,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 10:10:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 10:10:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,44159,1696587032316': 2023-10-06 10:10:52,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-06 10:10:52,689 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-06 10:10:52,690 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:10:52,690 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:10:52,690 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-06 10:10:52,690 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:10:52,695 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,695 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:52,695 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,695 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:52,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,695 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,696 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,696 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:52,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:52,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:10:52,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:10:52,700 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:10:52,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:52,703 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 10:10:52,704 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:10:52,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 10:10:52,717 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,729 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,738 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:10:52,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 10:10:52,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,782 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:52,782 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:52,782 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:52,782 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:52,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:52,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:52,782 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,782 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:10:52,783 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:52,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:52,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:52,782 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:10:52,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:10:52,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:10:52,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:10:52,782 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:10:52,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-06 10:10:52,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:52,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-06 10:10:52,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-06 10:10:52,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:52,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:52,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:52,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:10:52,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:10:52,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:10:52,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100635b19c856718490999bbf08f80355d6a, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006dbf1bb6ae23248bda169ef1d8fc78a3e] mob files 2023-10-06 10:10:52,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100635b19c856718490999bbf08f80355d6a 2023-10-06 10:10:52,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006dbf1bb6ae23248bda169ef1d8fc78a3e 2023-10-06 10:10:52,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:52,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:10:52,801 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-06 10:10:52,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-10-06 10:10:52,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-06 10:10:52,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-06 10:10:52,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,980 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-06 10:10:52,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696587051622Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696587052870 (+1248 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696587052870Loading Region manifests for snaptb0-testExportWithTargetName at 1696587052870Writing data manifest for snaptb0-testExportWithTargetName at 1696587052884 (+14 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696587052944 (+60 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696587052979 (+35 ms) 2023-10-06 10:10:52,990 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 10:10:52,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.3650 sec 2023-10-06 10:10:53,734 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 10:10:53,801 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:10:53,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 10:10:53,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:10:53,803 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803 2023-10-06 10:10:53,805 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43027, tgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803, rawTgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803, srcFsUri=hdfs://localhost:43027, srcDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:10:53,920 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:10:53,920 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-505957890_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-06 10:10:53,920 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae, snapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-06 10:10:54,112 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-06 10:10:54,882 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:54,883 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:54,883 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:54,884 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:56,055 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-2682879104046800608.jar 2023-10-06 10:10:56,056 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:56,057 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:56,137 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-5583611158513277592.jar 2023-10-06 10:10:56,138 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:56,139 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:56,139 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:56,140 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:56,141 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:56,141 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 10:10:56,142 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 10:10:56,142 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 10:10:56,143 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 10:10:56,144 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 10:10:56,144 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 10:10:56,145 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 10:10:56,145 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 10:10:56,146 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 10:10:56,146 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 10:10:56,147 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 10:10:56,152 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:10:56,153 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:10:56,153 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:10:56,154 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:10:56,154 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:10:56,155 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:10:56,156 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:11:00,310 WARN [Listener at jenkins-hbase17.apache.org/42055] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 10:11:00,318 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-06 10:11:00,338 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-06 10:11:01,098 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:11:01,108 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:11:01,619 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0001_000001 (auth:SIMPLE) 2023-10-06 10:11:09,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0001_000001 (auth:SIMPLE) 2023-10-06 10:11:11,615 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0001_000001 (auth:SIMPLE) 2023-10-06 10:11:17,096 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0001_000001 (auth:SIMPLE) 2023-10-06 10:11:18,771 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 10:11:18,777 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 10:11:18,804 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-06 10:11:18,804 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 10:11:18,805 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 10:11:18,805 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-06 10:11:18,806 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-06 10:11:18,806 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-06 10:11:18,806 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803/.hbase-snapshot/testExportWithTargetName 2023-10-06 10:11:18,807 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-06 10:11:18,807 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587053803/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-06 10:11:18,827 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-06 10:11:18,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportWithTargetName 2023-10-06 10:11:18,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-06 10:11:18,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 10:11:18,873 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587078873"}]},"ts":"1696587078873"} 2023-10-06 10:11:18,878 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-06 10:11:18,932 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-06 10:11:18,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=29e089d3fe6881a2adbc1ded58a4f869, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=82eee9dd7da54e3b41f49ff7607ed46b, UNASSIGN}] 2023-10-06 10:11:18,941 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=29e089d3fe6881a2adbc1ded58a4f869, UNASSIGN 2023-10-06 10:11:18,941 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=82eee9dd7da54e3b41f49ff7607ed46b, UNASSIGN 2023-10-06 10:11:18,943 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=29e089d3fe6881a2adbc1ded58a4f869, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:18,943 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587078943"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587078943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587078943"}]},"ts":"1696587078943"} 2023-10-06 10:11:18,947 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=82eee9dd7da54e3b41f49ff7607ed46b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:18,947 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587078944"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587078944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587078944"}]},"ts":"1696587078944"} 2023-10-06 10:11:18,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 29e089d3fe6881a2adbc1ded58a4f869, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:11:18,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 82eee9dd7da54e3b41f49ff7607ed46b, server=jenkins-hbase17.apache.org,44159,1696587032316}] 2023-10-06 10:11:18,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 10:11:19,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:11:19,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 29e089d3fe6881a2adbc1ded58a4f869, disabling compactions & flushes 2023-10-06 10:11:19,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:11:19,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:11:19,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. after waiting 0 ms 2023-10-06 10:11:19,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:11:19,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:11:19,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 82eee9dd7da54e3b41f49ff7607ed46b, disabling compactions & flushes 2023-10-06 10:11:19,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:11:19,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:11:19,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. after waiting 0 ms 2023-10-06 10:11:19,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:11:19,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 10:11:19,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:11:19,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:11:19,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:11:19,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869. 2023-10-06 10:11:19,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 29e089d3fe6881a2adbc1ded58a4f869: 2023-10-06 10:11:19,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:11:19,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b. 2023-10-06 10:11:19,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 82eee9dd7da54e3b41f49ff7607ed46b: 2023-10-06 10:11:19,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:11:19,238 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=82eee9dd7da54e3b41f49ff7607ed46b, regionState=CLOSED 2023-10-06 10:11:19,238 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587079238"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587079238"}]},"ts":"1696587079238"} 2023-10-06 10:11:19,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:11:19,241 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=29e089d3fe6881a2adbc1ded58a4f869, regionState=CLOSED 2023-10-06 10:11:19,242 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696587079241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587079241"}]},"ts":"1696587079241"} 2023-10-06 10:11:19,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-06 10:11:19,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 82eee9dd7da54e3b41f49ff7607ed46b, server=jenkins-hbase17.apache.org,44159,1696587032316 in 272 msec 2023-10-06 10:11:19,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-06 10:11:19,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 29e089d3fe6881a2adbc1ded58a4f869, server=jenkins-hbase17.apache.org,36349,1696587032478 in 296 msec 2023-10-06 10:11:19,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=82eee9dd7da54e3b41f49ff7607ed46b, UNASSIGN in 314 msec 2023-10-06 10:11:19,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-06 10:11:19,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=29e089d3fe6881a2adbc1ded58a4f869, UNASSIGN in 316 msec 2023-10-06 10:11:19,257 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587079257"}]},"ts":"1696587079257"} 2023-10-06 10:11:19,259 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-06 10:11:19,260 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-06 10:11:19,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 423 msec 2023-10-06 10:11:19,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 10:11:19,493 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-06 10:11:19,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportWithTargetName 2023-10-06 10:11:19,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 10:11:19,514 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 10:11:19,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-06 10:11:19,517 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 10:11:19,529 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-06 10:11:19,530 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:11:19,530 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:11:19,533 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 10:11:19,533 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 10:11:19,536 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 10:11:19,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-06 10:11:19,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-06 10:11:19,536 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-06 10:11:19,537 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/recovered.edits] 2023-10-06 10:11:19,537 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/recovered.edits] 2023-10-06 10:11:19,537 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 10:11:19,538 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 10:11:19,538 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:19,538 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 10:11:19,538 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:19,538 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 10:11:19,538 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:19,538 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:19,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-06 10:11:19,538 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 10:11:19,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-06 10:11:19,548 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/cf/1a64a44699a1485eb1ffa56706d62fd9 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/cf/1a64a44699a1485eb1ffa56706d62fd9 2023-10-06 10:11:19,548 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/cf/84723f240c4641e58ed6ecae5be596a3 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/cf/84723f240c4641e58ed6ecae5be596a3 2023-10-06 10:11:19,554 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869/recovered.edits/9.seqid 2023-10-06 10:11:19,555 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b/recovered.edits/9.seqid 2023-10-06 10:11:19,555 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/29e089d3fe6881a2adbc1ded58a4f869 2023-10-06 10:11:19,556 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportWithTargetName/82eee9dd7da54e3b41f49ff7607ed46b 2023-10-06 10:11:19,556 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-06 10:11:19,557 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-06 10:11:19,558 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-06 10:11:19,564 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100635b19c856718490999bbf08f80355d6a to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100635b19c856718490999bbf08f80355d6a 2023-10-06 10:11:19,566 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006dbf1bb6ae23248bda169ef1d8fc78a3e to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006dbf1bb6ae23248bda169ef1d8fc78a3e 2023-10-06 10:11:19,567 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-06 10:11:19,571 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 10:11:19,601 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-06 10:11:19,605 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-06 10:11:19,610 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 10:11:19,610 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-06 10:11:19,610 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587079610"}]},"ts":"9223372036854775807"} 2023-10-06 10:11:19,610 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587079610"}]},"ts":"9223372036854775807"} 2023-10-06 10:11:19,618 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 10:11:19,618 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 29e089d3fe6881a2adbc1ded58a4f869, NAME => 'testtb-testExportWithTargetName,,1696587047430.29e089d3fe6881a2adbc1ded58a4f869.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 82eee9dd7da54e3b41f49ff7607ed46b, NAME => 'testtb-testExportWithTargetName,1,1696587047430.82eee9dd7da54e3b41f49ff7607ed46b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 10:11:19,618 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-06 10:11:19,618 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696587079618"}]},"ts":"9223372036854775807"} 2023-10-06 10:11:19,626 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-06 10:11:19,633 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 10:11:19,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 131 msec 2023-10-06 10:11:19,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-06 10:11:19,648 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-06 10:11:19,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-06 10:11:19,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-06 10:11:19,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportWithTargetName" 2023-10-06 10:11:19,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-06 10:11:19,768 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=745 (was 702) Potentially hanging thread: Thread-1287 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:58126 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-505957890_17 at /127.0.0.1:40948 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_412297094_1 at /127.0.0.1:50948 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:50968 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_412297094_1 at /127.0.0.1:58112 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1956533468) connection to jenkins-hbase17.apache.org/136.243.18.41:42743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=967 (was 938) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 189) - ProcessCount LEAK? -, AvailableMemoryMB=1614 (was 3893) 2023-10-06 10:11:19,769 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-10-06 10:11:19,804 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=745, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=967, ProcessCount=192, AvailableMemoryMB=1612 2023-10-06 10:11:19,804 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-10-06 10:11:19,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 10:11:19,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-06 10:11:19,825 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 10:11:19,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-06 10:11:19,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 10:11:19,833 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 10:11:19,843 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:19,843 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:19,849 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7 empty. 2023-10-06 10:11:19,850 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3 empty. 2023-10-06 10:11:19,854 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:19,858 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:19,858 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-06 10:11:19,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 10:11:20,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 10:11:20,301 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-06 10:11:20,303 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 04535f60677bcc349a07f7e7b46006f7, NAME => 'testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:11:20,308 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8ea57228e331ffa6fff37afb8c249fd3, NAME => 'testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:11:20,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:11:20,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 04535f60677bcc349a07f7e7b46006f7, disabling compactions & flushes 2023-10-06 10:11:20,371 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:20,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:20,371 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. after waiting 0 ms 2023-10-06 10:11:20,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:20,372 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:20,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 04535f60677bcc349a07f7e7b46006f7: 2023-10-06 10:11:20,377 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:11:20,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8ea57228e331ffa6fff37afb8c249fd3, disabling compactions & flushes 2023-10-06 10:11:20,379 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:20,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:20,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. after waiting 0 ms 2023-10-06 10:11:20,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:20,379 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:20,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8ea57228e331ffa6fff37afb8c249fd3: 2023-10-06 10:11:20,383 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 10:11:20,384 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587080384"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587080384"}]},"ts":"1696587080384"} 2023-10-06 10:11:20,384 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587080384"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587080384"}]},"ts":"1696587080384"} 2023-10-06 10:11:20,389 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 10:11:20,390 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 10:11:20,390 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587080390"}]},"ts":"1696587080390"} 2023-10-06 10:11:20,393 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-06 10:11:20,395 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:11:20,397 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:11:20,397 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:11:20,397 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:11:20,397 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:11:20,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea57228e331ffa6fff37afb8c249fd3, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04535f60677bcc349a07f7e7b46006f7, ASSIGN}] 2023-10-06 10:11:20,400 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea57228e331ffa6fff37afb8c249fd3, ASSIGN 2023-10-06 10:11:20,401 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04535f60677bcc349a07f7e7b46006f7, ASSIGN 2023-10-06 10:11:20,401 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea57228e331ffa6fff37afb8c249fd3, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40269,1696587032407; forceNewPlan=false, retain=false 2023-10-06 10:11:20,401 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04535f60677bcc349a07f7e7b46006f7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36349,1696587032478; forceNewPlan=false, retain=false 2023-10-06 10:11:20,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 10:11:20,552 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 10:11:20,555 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8ea57228e331ffa6fff37afb8c249fd3, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:20,555 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=04535f60677bcc349a07f7e7b46006f7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:20,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587080554"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587080554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587080554"}]},"ts":"1696587080554"} 2023-10-06 10:11:20,555 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587080554"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587080554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587080554"}]},"ts":"1696587080554"} 2023-10-06 10:11:20,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 8ea57228e331ffa6fff37afb8c249fd3, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:11:20,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 04535f60677bcc349a07f7e7b46006f7, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:11:20,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:20,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04535f60677bcc349a07f7e7b46006f7, NAME => 'testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 10:11:20,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. service=AccessControlService 2023-10-06 10:11:20,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:11:20,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:20,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:11:20,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:20,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:20,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:20,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8ea57228e331ffa6fff37afb8c249fd3, NAME => 'testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 10:11:20,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. service=AccessControlService 2023-10-06 10:11:20,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:11:20,725 INFO [StoreOpener-04535f60677bcc349a07f7e7b46006f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:20,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:20,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:11:20,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:20,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:20,727 DEBUG [StoreOpener-04535f60677bcc349a07f7e7b46006f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/cf 2023-10-06 10:11:20,727 DEBUG [StoreOpener-04535f60677bcc349a07f7e7b46006f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/cf 2023-10-06 10:11:20,728 INFO [StoreOpener-04535f60677bcc349a07f7e7b46006f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04535f60677bcc349a07f7e7b46006f7 columnFamilyName cf 2023-10-06 10:11:20,729 INFO [StoreOpener-8ea57228e331ffa6fff37afb8c249fd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:20,732 INFO [StoreOpener-04535f60677bcc349a07f7e7b46006f7-1] regionserver.HStore(310): Store=04535f60677bcc349a07f7e7b46006f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:11:20,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:20,735 DEBUG [StoreOpener-8ea57228e331ffa6fff37afb8c249fd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/cf 2023-10-06 10:11:20,735 DEBUG [StoreOpener-8ea57228e331ffa6fff37afb8c249fd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/cf 2023-10-06 10:11:20,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:20,735 INFO [StoreOpener-8ea57228e331ffa6fff37afb8c249fd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ea57228e331ffa6fff37afb8c249fd3 columnFamilyName cf 2023-10-06 10:11:20,736 INFO [StoreOpener-8ea57228e331ffa6fff37afb8c249fd3-1] regionserver.HStore(310): Store=8ea57228e331ffa6fff37afb8c249fd3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:11:20,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:20,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:20,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:20,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:11:20,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 04535f60677bcc349a07f7e7b46006f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60343731, jitterRate=-0.10080833733081818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:11:20,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 04535f60677bcc349a07f7e7b46006f7: 2023-10-06 10:11:20,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7., pid=31, masterSystemTime=1696587080712 2023-10-06 10:11:20,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:20,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:20,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:20,747 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=04535f60677bcc349a07f7e7b46006f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:20,748 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587080747"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587080747"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587080747"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587080747"}]},"ts":"1696587080747"} 2023-10-06 10:11:20,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:11:20,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8ea57228e331ffa6fff37afb8c249fd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68962838, jitterRate=0.027626365423202515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:11:20,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8ea57228e331ffa6fff37afb8c249fd3: 2023-10-06 10:11:20,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-06 10:11:20,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 04535f60677bcc349a07f7e7b46006f7, server=jenkins-hbase17.apache.org,36349,1696587032478 in 194 msec 2023-10-06 10:11:20,760 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04535f60677bcc349a07f7e7b46006f7, ASSIGN in 360 msec 2023-10-06 10:11:20,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3., pid=30, masterSystemTime=1696587080711 2023-10-06 10:11:20,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:20,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:20,764 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8ea57228e331ffa6fff37afb8c249fd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:20,764 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587080764"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587080764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587080764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587080764"}]},"ts":"1696587080764"} 2023-10-06 10:11:20,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-06 10:11:20,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 8ea57228e331ffa6fff37afb8c249fd3, server=jenkins-hbase17.apache.org,40269,1696587032407 in 209 msec 2023-10-06 10:11:20,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-06 10:11:20,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea57228e331ffa6fff37afb8c249fd3, ASSIGN in 371 msec 2023-10-06 10:11:20,777 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 10:11:20,778 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587080777"}]},"ts":"1696587080777"} 2023-10-06 10:11:20,779 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-06 10:11:20,782 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 10:11:20,782 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-06 10:11:20,788 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 10:11:20,795 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:20,795 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:20,795 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:20,795 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:20,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 10:11:20,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 10:11:20,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 980 msec 2023-10-06 10:11:20,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 10:11:20,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 10:11:20,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 10:11:20,938 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-06 10:11:20,942 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-06 10:11:20,943 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:20,945 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:11:20,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:11:20,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587080984 (current time:1696587080984). 2023-10-06 10:11:20,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:11:20,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x154d3d84 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:11:20,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@687b1ced, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:11:20,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:21,002 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:21,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x154d3d84 to 127.0.0.1:65169 2023-10-06 10:11:21,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:11:21,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x6fc1218b to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:11:21,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@139c80ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:11:21,108 DEBUG [hconnection-0x23306a00-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:21,111 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:21,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:21,117 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:21,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fc1218b to 127.0.0.1:65169 2023-10-06 10:11:21,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:11:21,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 10:11:21,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:11:21,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:11:21,123 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:11:21,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:11:21,126 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:11:21,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:11:21,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-06 10:11:21,128 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696587681128 2023-10-06 10:11:21,129 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:11:21,129 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:11:21,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 10:11:21,131 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:11:21,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-06 10:11:21,134 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 10:11:21,135 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696587681135 2023-10-06 10:11:21,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,151 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-06 10:11:21,151 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:21,153 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-06 10:11:21,153 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-06 10:11:21,153 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,153 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,154 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:21,154 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:21,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:21,154 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:21,154 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:21,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:21,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:21,155 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,155 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,156 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,156 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,156 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 10:11:21,156 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 10:11:21,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,156 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:21,157 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 10:11:21,156 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:21,158 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:21,158 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 10:11:21,161 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-06 10:11:21,161 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 10:11:21,159 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 10:11:21,161 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-06 10:11:21,161 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-06 10:11:21,161 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-06 10:11:21,161 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-06 10:11:21,161 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-06 10:11:21,162 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,165 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,165 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,165 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,165 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,165 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:21,166 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:21,166 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,166 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:21,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:21,166 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,166 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:21,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:21,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:21,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:21,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-06 10:11:21,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79debcc8[Count = 1] remaining members to acquire global barrier 2023-10-06 10:11:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:21,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-06 10:11:21,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79debcc8[Count = 0] remaining members to acquire global barrier 2023-10-06 10:11:21,170 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 10:11:21,170 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,171 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,171 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,171 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,171 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:11:21,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,171 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:11:21,172 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,172 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:11:21,172 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:11:21,172 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:21,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,172 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. started... 2023-10-06 10:11:21,172 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-06 10:11:21,172 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:11:21,172 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:11:21,172 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,172 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:11:21,172 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ea57228e331ffa6fff37afb8c249fd3: 2023-10-06 10:11:21,172 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:11:21,172 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:11:21,172 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:21,172 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. started... 2023-10-06 10:11:21,172 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,172 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:11:21,174 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04535f60677bcc349a07f7e7b46006f7: 2023-10-06 10:11:21,174 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:11:21,174 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,174 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:11:21,174 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:11:21,175 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 10:11:21,175 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:21,175 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-06 10:11:21,184 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. completed. 2023-10-06 10:11:21,185 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:21,185 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:11:21,185 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:11:21,185 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,185 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-06 10:11:21,185 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:11:21,186 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 10:11:21,186 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:21,186 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,186 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-06 10:11:21,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:21,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:21,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:21,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:21,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,191 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. completed. 2023-10-06 10:11:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:21,191 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:21,191 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:11:21,191 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:11:21,191 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,191 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-06 10:11:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,191 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:11:21,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,192 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,192 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 10:11:21,193 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:21,193 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-06 10:11:21,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:11:21,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 10:11:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,36349,1696587032478': 2023-10-06 10:11:21,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 10:11:21,198 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-06 10:11:21,198 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:11:21,198 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:11:21,198 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,198 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:11:21,199 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,199 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:21,200 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:21,200 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:21,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:21,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:21,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:21,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,205 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:21,209 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,222 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:21,223 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,223 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,227 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,227 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,227 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,227 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,227 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:21,227 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:21,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:21,227 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:21,228 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:21,228 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,228 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:21,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:21,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:21,228 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:21,228 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:21,228 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,229 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,229 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:21,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:21,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-06 10:11:21,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:11:21,229 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:21,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:21,229 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:21,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:21,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 10:11:21,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:21,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:11:21,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:21,232 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:11:21,233 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:21,233 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:21,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:21,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:21,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:21,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:21,432 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:21,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:11:21,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:21,434 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:11:21,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,682 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-06 10:11:21,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,683 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:21,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696587081128Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696587081642 (+514 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696587081642Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696587081642Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696587081652 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696587081671 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696587081682 (+11 ms) 2023-10-06 10:11:21,685 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 10:11:21,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 556 msec 2023-10-06 10:11:21,734 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:21,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:11:21,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:11:21,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40269] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:11:21,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:11:21,761 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-06 10:11:21,761 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:21,761 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:11:21,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:11:21,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587081785 (current time:1696587081785). 2023-10-06 10:11:21,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:11:21,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x4427f265 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:11:21,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@284ecc89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:11:21,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:21,808 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:21,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4427f265 to 127.0.0.1:65169 2023-10-06 10:11:21,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:11:21,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x1fa6a007 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:11:21,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a9d7fdc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:11:21,830 DEBUG [hconnection-0x2c9ad85e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:21,832 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:21,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:21,850 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:21,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fa6a007 to 127.0.0.1:65169 2023-10-06 10:11:21,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:11:21,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 10:11:21,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:11:21,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:11:21,859 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:11:21,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:11:21,863 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:11:21,865 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696587681865 2023-10-06 10:11:21,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:11:21,865 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-06 10:11:21,866 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:11:21,866 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:11:21,871 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:11:21,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 10:11:21,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-10-06 10:11:21,876 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 10:11:21,877 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696587681877 2023-10-06 10:11:21,966 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:21,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:11:21,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:21,968 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:11:22,168 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:22,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:11:22,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:22,170 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:11:22,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-06 10:11:22,313 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-06 10:11:22,313 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:22,313 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-06 10:11:22,313 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-06 10:11:22,314 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,314 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,315 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:22,315 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:22,315 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:22,315 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:22,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:22,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-06 10:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,317 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 10:11:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-06 10:11:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,317 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,317 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 10:11:22,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-06 10:11:22,317 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,317 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 10:11:22,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-06 10:11:22,317 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-06 10:11:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,319 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 10:11:22,319 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-06 10:11:22,319 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-06 10:11:22,319 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,319 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:11:22,317 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 10:11:22,320 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:22,319 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 10:11:22,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-06 10:11:22,329 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 10:11:22,329 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-06 10:11:22,329 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-06 10:11:22,332 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,333 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 10:11:22,333 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:22,338 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 10:11:22,338 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-06 10:11:22,338 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-06 10:11:22,340 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,340 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:22,341 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:22,341 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,342 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:22,345 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 10:11:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,350 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,350 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:22,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-06 10:11:22,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bdaee63[Count = 1] remaining members to acquire global barrier 2023-10-06 10:11:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 10:11:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:22,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-06 10:11:22,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bdaee63[Count = 0] remaining members to acquire global barrier 2023-10-06 10:11:22,361 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 10:11:22,361 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,363 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,364 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:11:22,364 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,364 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,364 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,364 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:11:22,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,364 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:11:22,364 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-06 10:11:22,364 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:11:22,365 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:11:22,365 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:11:22,368 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:22,368 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. started... 2023-10-06 10:11:22,368 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 04535f60677bcc349a07f7e7b46006f7 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-06 10:11:22,368 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:11:22,368 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:11:22,369 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:22,369 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. started... 2023-10-06 10:11:22,369 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8ea57228e331ffa6fff37afb8c249fd3 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-06 10:11:22,369 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,369 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:11:22,388 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 10:11:22,388 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:22,388 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-06 10:11:22,473 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:22,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:11:22,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:22,475 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-06 10:11:22,510 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006ef5221fee2544c56b5d19162335e4282 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006ef5221fee2544c56b5d19162335e4282 2023-10-06 10:11:22,517 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100697bb41b797c64bd3bc4d37caafa7a3e2 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100697bb41b797c64bd3bc4d37caafa7a3e2 2023-10-06 10:11:22,557 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/.tmp/cf/765c4a10a01b4821a40751cb61f8a27c 2023-10-06 10:11:22,572 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/.tmp/cf/765c4a10a01b4821a40751cb61f8a27c as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/cf/765c4a10a01b4821a40751cb61f8a27c 2023-10-06 10:11:22,585 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/cf/765c4a10a01b4821a40751cb61f8a27c, entries=2, sequenceid=6, filesize=5.2 K 2023-10-06 10:11:22,589 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/.tmp/cf/78edcc0c62534e2dadf2bc75fceb265e 2023-10-06 10:11:22,597 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 8ea57228e331ffa6fff37afb8c249fd3 in 228ms, sequenceid=6, compaction requested=false 2023-10-06 10:11:22,598 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-06 10:11:22,598 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/.tmp/cf/78edcc0c62534e2dadf2bc75fceb265e as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/cf/78edcc0c62534e2dadf2bc75fceb265e 2023-10-06 10:11:22,600 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ea57228e331ffa6fff37afb8c249fd3: 2023-10-06 10:11:22,600 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-06 10:11:22,600 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:11:22,600 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/cf/765c4a10a01b4821a40751cb61f8a27c] hfiles 2023-10-06 10:11:22,600 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/cf/765c4a10a01b4821a40751cb61f8a27c for snapshot=snaptb0-testExportFileSystemState 2023-10-06 10:11:22,614 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/cf/78edcc0c62534e2dadf2bc75fceb265e, entries=48, sequenceid=6, filesize=13.0 K 2023-10-06 10:11:22,625 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 04535f60677bcc349a07f7e7b46006f7 in 257ms, sequenceid=6, compaction requested=false 2023-10-06 10:11:22,627 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04535f60677bcc349a07f7e7b46006f7: 2023-10-06 10:11:22,627 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-06 10:11:22,627 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:11:22,627 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/cf/78edcc0c62534e2dadf2bc75fceb265e] hfiles 2023-10-06 10:11:22,627 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/cf/78edcc0c62534e2dadf2bc75fceb265e for snapshot=snaptb0-testExportFileSystemState 2023-10-06 10:11:22,669 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. completed. 2023-10-06 10:11:22,669 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:22,673 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:11:22,673 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:11:22,673 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,673 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-06 10:11:22,673 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:11:22,684 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,684 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 10:11:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:22,685 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:22,685 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-06 10:11:22,687 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. completed. 2023-10-06 10:11:22,687 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:22,687 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:11:22,687 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:11:22,688 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,688 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-06 10:11:22,688 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:11:22,689 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 10:11:22,689 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,689 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:22,689 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-06 10:11:22,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 10:11:22,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 10:11:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:11:22,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 10:11:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:22,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:22,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:22,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 10:11:22,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:22,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 10:11:22,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,36349,1696587032478': 2023-10-06 10:11:22,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 10:11:22,719 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-06 10:11:22,719 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:11:22,719 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:11:22,719 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-06 10:11:22,719 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:11:22,720 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,720 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:22,720 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,720 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,720 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:22,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:22,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,720 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:22,720 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:22,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:22,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:22,721 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:22,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:22,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:22,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:22,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:22,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,722 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 10:11:22,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,722 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:22,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 10:11:22,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:22,724 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 10:11:22,724 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,725 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,730 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:22,730 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:22,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:22,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:22,730 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:22,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:22,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:22,730 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:22,730 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:22,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:22,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:22,730 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:22,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:22,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:22,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:22,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:22,731 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,731 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:22,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:22,731 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,731 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,732 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,732 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:22,732 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,732 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:22,732 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:22,732 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,732 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 10:11:22,732 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:22,732 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-06 10:11:22,733 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-06 10:11:22,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-06 10:11:22,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:11:22,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100697bb41b797c64bd3bc4d37caafa7a3e2, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006ef5221fee2544c56b5d19162335e4282] mob files 2023-10-06 10:11:22,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100697bb41b797c64bd3bc4d37caafa7a3e2 2023-10-06 10:11:22,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006ef5221fee2544c56b5d19162335e4282 2023-10-06 10:11:22,975 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:22,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:11:22,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:22,978 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-06 10:11:23,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-06 10:11:23,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 10:11:23,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-06 10:11:23,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-06 10:11:23,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 10:11:23,262 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 10:11:23,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696587081865Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696587083191 (+1326 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696587083191Loading Region manifests for snaptb0-testExportFileSystemState at 1696587083191Writing data manifest for snaptb0-testExportFileSystemState at 1696587083206 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696587083225 (+19 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696587083262 (+37 ms) 2023-10-06 10:11:23,268 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 10:11:23,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 1.4000 sec 2023-10-06 10:11:23,299 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0001_000001 (auth:SIMPLE) 2023-10-06 10:11:23,978 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:23,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:11:23,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:11:23,979 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979 2023-10-06 10:11:23,979 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43027, tgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979, rawTgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979, srcFsUri=hdfs://localhost:43027, srcDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:11:24,011 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:11:24,012 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2090017784_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 10:11:24,012 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae, snapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-06 10:11:24,040 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 10:11:24,134 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:24,135 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:24,135 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:24,136 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:24,858 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 10:11:25,298 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-3570607241894503551.jar 2023-10-06 10:11:25,299 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:25,300 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:25,389 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-8969454318135497178.jar 2023-10-06 10:11:25,390 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:25,390 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:25,391 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:25,392 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:25,392 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:25,392 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:25,393 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 10:11:25,394 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 10:11:25,394 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 10:11:25,395 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 10:11:25,395 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 10:11:25,396 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 10:11:25,396 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 10:11:25,397 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 10:11:25,397 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 10:11:25,398 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 10:11:25,399 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:11:25,400 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:11:25,400 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:11:25,401 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:11:25,401 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:11:25,402 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:11:25,403 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:11:28,483 WARN [Listener at jenkins-hbase17.apache.org/42055] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 10:11:28,487 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-06 10:11:28,489 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-06 10:11:28,579 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:11:28,579 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:11:29,311 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0002_000001 (auth:SIMPLE) 2023-10-06 10:11:35,285 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0002_000001 (auth:SIMPLE) 2023-10-06 10:11:37,639 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0002_000001 (auth:SIMPLE) 2023-10-06 10:11:44,838 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 10:11:44,846 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 10:11:44,894 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-06 10:11:44,894 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 10:11:44,900 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 10:11:44,900 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-06 10:11:44,905 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-06 10:11:44,906 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-06 10:11:44,906 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-06 10:11:44,908 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-06 10:11:44,908 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587083979/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-06 10:11:44,931 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-06 10:11:44,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemState 2023-10-06 10:11:44,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-06 10:11:44,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 10:11:44,958 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587104958"}]},"ts":"1696587104958"} 2023-10-06 10:11:44,962 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-06 10:11:45,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 10:11:45,085 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-06 10:11:45,086 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea57228e331ffa6fff37afb8c249fd3, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04535f60677bcc349a07f7e7b46006f7, UNASSIGN}] 2023-10-06 10:11:45,088 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea57228e331ffa6fff37afb8c249fd3, UNASSIGN 2023-10-06 10:11:45,088 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04535f60677bcc349a07f7e7b46006f7, UNASSIGN 2023-10-06 10:11:45,090 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8ea57228e331ffa6fff37afb8c249fd3, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:45,090 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=04535f60677bcc349a07f7e7b46006f7, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:45,090 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587105090"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587105090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587105090"}]},"ts":"1696587105090"} 2023-10-06 10:11:45,090 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587105090"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587105090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587105090"}]},"ts":"1696587105090"} 2023-10-06 10:11:45,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 8ea57228e331ffa6fff37afb8c249fd3, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:11:45,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 04535f60677bcc349a07f7e7b46006f7, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:11:45,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:45,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8ea57228e331ffa6fff37afb8c249fd3, disabling compactions & flushes 2023-10-06 10:11:45,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:45,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:45,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 04535f60677bcc349a07f7e7b46006f7, disabling compactions & flushes 2023-10-06 10:11:45,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:45,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:45,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. after waiting 0 ms 2023-10-06 10:11:45,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:45,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:45,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. after waiting 0 ms 2023-10-06 10:11:45,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:45,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 10:11:45,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:11:45,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:11:45,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7. 2023-10-06 10:11:45,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 04535f60677bcc349a07f7e7b46006f7: 2023-10-06 10:11:45,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:45,282 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=04535f60677bcc349a07f7e7b46006f7, regionState=CLOSED 2023-10-06 10:11:45,283 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587105282"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587105282"}]},"ts":"1696587105282"} 2023-10-06 10:11:45,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:11:45,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:11:45,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3. 2023-10-06 10:11:45,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8ea57228e331ffa6fff37afb8c249fd3: 2023-10-06 10:11:45,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-06 10:11:45,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 04535f60677bcc349a07f7e7b46006f7, server=jenkins-hbase17.apache.org,36349,1696587032478 in 192 msec 2023-10-06 10:11:45,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:45,290 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8ea57228e331ffa6fff37afb8c249fd3, regionState=CLOSED 2023-10-06 10:11:45,290 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696587105290"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587105290"}]},"ts":"1696587105290"} 2023-10-06 10:11:45,291 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04535f60677bcc349a07f7e7b46006f7, UNASSIGN in 203 msec 2023-10-06 10:11:45,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-06 10:11:45,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 8ea57228e331ffa6fff37afb8c249fd3, server=jenkins-hbase17.apache.org,40269,1696587032407 in 209 msec 2023-10-06 10:11:45,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-06 10:11:45,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8ea57228e331ffa6fff37afb8c249fd3, UNASSIGN in 217 msec 2023-10-06 10:11:45,306 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587105306"}]},"ts":"1696587105306"} 2023-10-06 10:11:45,308 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-06 10:11:45,309 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-06 10:11:45,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 372 msec 2023-10-06 10:11:45,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 10:11:45,570 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-06 10:11:45,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemState 2023-10-06 10:11:45,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 10:11:45,575 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 10:11:45,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-06 10:11:45,576 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 10:11:45,579 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-06 10:11:45,581 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 10:11:45,581 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 10:11:45,581 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 10:11:45,581 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 10:11:45,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 10:11:45,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 10:11:45,583 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 10:11:45,583 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 10:11:45,583 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 10:11:45,583 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:45,583 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 10:11:45,583 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:45,583 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 10:11:45,583 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:45,583 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 10:11:45,583 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:45,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-06 10:11:45,584 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:45,586 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:45,587 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/recovered.edits] 2023-10-06 10:11:45,588 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/recovered.edits] 2023-10-06 10:11:45,596 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/cf/78edcc0c62534e2dadf2bc75fceb265e to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/cf/78edcc0c62534e2dadf2bc75fceb265e 2023-10-06 10:11:45,596 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/cf/765c4a10a01b4821a40751cb61f8a27c to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/cf/765c4a10a01b4821a40751cb61f8a27c 2023-10-06 10:11:45,600 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3/recovered.edits/9.seqid 2023-10-06 10:11:45,601 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/8ea57228e331ffa6fff37afb8c249fd3 2023-10-06 10:11:45,606 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7/recovered.edits/9.seqid 2023-10-06 10:11:45,608 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemState/04535f60677bcc349a07f7e7b46006f7 2023-10-06 10:11:45,608 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-06 10:11:45,608 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-06 10:11:45,609 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-06 10:11:45,613 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100697bb41b797c64bd3bc4d37caafa7a3e2 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100697bb41b797c64bd3bc4d37caafa7a3e2 2023-10-06 10:11:45,614 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006ef5221fee2544c56b5d19162335e4282 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006ef5221fee2544c56b5d19162335e4282 2023-10-06 10:11:45,614 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-06 10:11:45,619 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 10:11:45,623 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-06 10:11:45,630 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-06 10:11:45,632 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 10:11:45,632 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-06 10:11:45,632 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587105632"}]},"ts":"9223372036854775807"} 2023-10-06 10:11:45,632 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587105632"}]},"ts":"9223372036854775807"} 2023-10-06 10:11:45,635 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 10:11:45,635 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8ea57228e331ffa6fff37afb8c249fd3, NAME => 'testtb-testExportFileSystemState,,1696587079814.8ea57228e331ffa6fff37afb8c249fd3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 04535f60677bcc349a07f7e7b46006f7, NAME => 'testtb-testExportFileSystemState,1,1696587079814.04535f60677bcc349a07f7e7b46006f7.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 10:11:45,635 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-06 10:11:45,636 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696587105636"}]},"ts":"9223372036854775807"} 2023-10-06 10:11:45,643 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-06 10:11:45,646 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 10:11:45,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 76 msec 2023-10-06 10:11:45,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-06 10:11:45,687 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-06 10:11:45,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-06 10:11:45,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-06 10:11:45,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemState" 2023-10-06 10:11:45,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-06 10:11:45,731 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=746 (was 745) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:34932 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:60632 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_920530868_1 at /127.0.0.1:34896 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1961 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:37214 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1956533468) connection to localhost/127.0.0.1:43027 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1956533468) connection to jenkins-hbase17.apache.org/136.243.18.41:32955 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1956533468) connection to jenkins-hbase17.apache.org/136.243.18.41:45871 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=968 (was 967) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 192), AvailableMemoryMB=2134 (was 1612) - AvailableMemoryMB LEAK? - 2023-10-06 10:11:45,731 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-10-06 10:11:45,759 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=968, ProcessCount=192, AvailableMemoryMB=2558 2023-10-06 10:11:45,760 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-10-06 10:11:45,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 10:11:45,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-06 10:11:45,769 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 10:11:45,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-06 10:11:45,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 10:11:45,772 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 10:11:45,774 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:11:45,774 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:11:45,775 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66 empty. 2023-10-06 10:11:45,775 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7 empty. 2023-10-06 10:11:45,775 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:11:45,776 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:11:45,776 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-06 10:11:45,795 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-06 10:11:45,797 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a44aeee528fd15435331bb29e18b6c66, NAME => 'testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:11:45,797 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8fbbd1fb09a075b1b9aa918037969ab7, NAME => 'testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:11:45,834 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:11:45,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a44aeee528fd15435331bb29e18b6c66, disabling compactions & flushes 2023-10-06 10:11:45,843 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:45,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:45,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. after waiting 0 ms 2023-10-06 10:11:45,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:45,843 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:45,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a44aeee528fd15435331bb29e18b6c66: 2023-10-06 10:11:45,851 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:11:45,853 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 8fbbd1fb09a075b1b9aa918037969ab7, disabling compactions & flushes 2023-10-06 10:11:45,853 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:45,853 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:45,853 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. after waiting 0 ms 2023-10-06 10:11:45,853 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:45,853 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:45,854 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 8fbbd1fb09a075b1b9aa918037969ab7: 2023-10-06 10:11:45,857 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 10:11:45,865 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587105865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587105865"}]},"ts":"1696587105865"} 2023-10-06 10:11:45,866 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587105865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587105865"}]},"ts":"1696587105865"} 2023-10-06 10:11:45,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 10:11:45,876 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 10:11:45,881 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 10:11:45,881 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587105881"}]},"ts":"1696587105881"} 2023-10-06 10:11:45,890 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-06 10:11:45,926 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:11:45,928 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:11:45,928 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:11:45,928 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:11:45,928 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:11:45,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a44aeee528fd15435331bb29e18b6c66, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fbbd1fb09a075b1b9aa918037969ab7, ASSIGN}] 2023-10-06 10:11:45,938 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fbbd1fb09a075b1b9aa918037969ab7, ASSIGN 2023-10-06 10:11:45,938 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a44aeee528fd15435331bb29e18b6c66, ASSIGN 2023-10-06 10:11:45,940 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fbbd1fb09a075b1b9aa918037969ab7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44159,1696587032316; forceNewPlan=false, retain=false 2023-10-06 10:11:45,941 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a44aeee528fd15435331bb29e18b6c66, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40269,1696587032407; forceNewPlan=false, retain=false 2023-10-06 10:11:46,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 10:11:46,091 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 10:11:46,094 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a44aeee528fd15435331bb29e18b6c66, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:46,094 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8fbbd1fb09a075b1b9aa918037969ab7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:46,094 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587106094"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587106094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587106094"}]},"ts":"1696587106094"} 2023-10-06 10:11:46,094 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587106094"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587106094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587106094"}]},"ts":"1696587106094"} 2023-10-06 10:11:46,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 8fbbd1fb09a075b1b9aa918037969ab7, server=jenkins-hbase17.apache.org,44159,1696587032316}] 2023-10-06 10:11:46,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure a44aeee528fd15435331bb29e18b6c66, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:11:46,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:46,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:46,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a44aeee528fd15435331bb29e18b6c66, NAME => 'testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 10:11:46,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fbbd1fb09a075b1b9aa918037969ab7, NAME => 'testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 10:11:46,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. service=AccessControlService 2023-10-06 10:11:46,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. service=AccessControlService 2023-10-06 10:11:46,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:11:46,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:11:46,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:11:46,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:11:46,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:11:46,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:11:46,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:11:46,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:11:46,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:11:46,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:11:46,259 INFO [StoreOpener-8fbbd1fb09a075b1b9aa918037969ab7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:11:46,259 INFO [StoreOpener-a44aeee528fd15435331bb29e18b6c66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:11:46,261 DEBUG [StoreOpener-8fbbd1fb09a075b1b9aa918037969ab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/cf 2023-10-06 10:11:46,261 DEBUG [StoreOpener-8fbbd1fb09a075b1b9aa918037969ab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/cf 2023-10-06 10:11:46,261 INFO [StoreOpener-8fbbd1fb09a075b1b9aa918037969ab7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fbbd1fb09a075b1b9aa918037969ab7 columnFamilyName cf 2023-10-06 10:11:46,263 INFO [StoreOpener-8fbbd1fb09a075b1b9aa918037969ab7-1] regionserver.HStore(310): Store=8fbbd1fb09a075b1b9aa918037969ab7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:11:46,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:11:46,266 DEBUG [StoreOpener-a44aeee528fd15435331bb29e18b6c66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/cf 2023-10-06 10:11:46,266 DEBUG [StoreOpener-a44aeee528fd15435331bb29e18b6c66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/cf 2023-10-06 10:11:46,266 INFO [StoreOpener-a44aeee528fd15435331bb29e18b6c66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a44aeee528fd15435331bb29e18b6c66 columnFamilyName cf 2023-10-06 10:11:46,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:11:46,267 INFO [StoreOpener-a44aeee528fd15435331bb29e18b6c66-1] regionserver.HStore(310): Store=a44aeee528fd15435331bb29e18b6c66/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:11:46,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:11:46,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:11:46,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:11:46,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:11:46,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8fbbd1fb09a075b1b9aa918037969ab7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61798720, jitterRate=-0.07912731170654297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:11:46,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:11:46,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8fbbd1fb09a075b1b9aa918037969ab7: 2023-10-06 10:11:46,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7., pid=45, masterSystemTime=1696587106251 2023-10-06 10:11:46,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:11:46,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:46,277 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8fbbd1fb09a075b1b9aa918037969ab7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:46,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:46,277 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587106277"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587106277"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587106277"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587106277"}]},"ts":"1696587106277"} 2023-10-06 10:11:46,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a44aeee528fd15435331bb29e18b6c66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60030930, jitterRate=-0.10546943545341492}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:11:46,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a44aeee528fd15435331bb29e18b6c66: 2023-10-06 10:11:46,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66., pid=46, masterSystemTime=1696587106251 2023-10-06 10:11:46,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:46,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:46,280 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a44aeee528fd15435331bb29e18b6c66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:46,281 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587106280"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587106280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587106280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587106280"}]},"ts":"1696587106280"} 2023-10-06 10:11:46,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-06 10:11:46,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 8fbbd1fb09a075b1b9aa918037969ab7, server=jenkins-hbase17.apache.org,44159,1696587032316 in 182 msec 2023-10-06 10:11:46,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fbbd1fb09a075b1b9aa918037969ab7, ASSIGN in 358 msec 2023-10-06 10:11:46,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-10-06 10:11:46,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure a44aeee528fd15435331bb29e18b6c66, server=jenkins-hbase17.apache.org,40269,1696587032407 in 188 msec 2023-10-06 10:11:46,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-06 10:11:46,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a44aeee528fd15435331bb29e18b6c66, ASSIGN in 362 msec 2023-10-06 10:11:46,295 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 10:11:46,295 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587106295"}]},"ts":"1696587106295"} 2023-10-06 10:11:46,296 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-06 10:11:46,298 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 10:11:46,299 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-06 10:11:46,301 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-06 10:11:46,313 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:46,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:46,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:46,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:11:46,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 10:11:46,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 10:11:46,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 10:11:46,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 10:11:46,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 552 msec 2023-10-06 10:11:46,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 10:11:46,385 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-06 10:11:46,402 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-06 10:11:46,402 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:46,406 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:11:46,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 10:11:46,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587106428 (current time:1696587106428). 2023-10-06 10:11:46,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:11:46,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x1dbb5a5e to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:11:46,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c818e2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:11:46,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:46,485 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:46,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dbb5a5e to 127.0.0.1:65169 2023-10-06 10:11:46,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:11:46,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x2c765cc3 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:11:46,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bd88ab9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:11:46,514 DEBUG [hconnection-0x4b08a936-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:46,525 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:46,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:46,537 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c765cc3 to 127.0.0.1:65169 2023-10-06 10:11:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:11:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-06 10:11:46,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:11:46,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 10:11:46,560 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:11:46,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 10:11:46,564 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 10:11:46,565 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696587706565 2023-10-06 10:11:46,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 10:11:46,566 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:11:46,566 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:11:46,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-06 10:11:46,574 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 10:11:46,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 13 msec 2023-10-06 10:11:46,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 10:11:46,579 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 10:11:46,584 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696587706584 2023-10-06 10:11:46,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,656 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-06 10:11:46,657 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:46,658 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-06 10:11:46,658 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-06 10:11:46,659 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,659 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,660 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:46,660 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:46,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:46,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:46,660 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:46,660 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:46,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-06 10:11:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-06 10:11:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 10:11:46,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 10:11:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-06 10:11:46,662 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,662 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:46,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 10:11:46,663 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:46,663 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:11:46,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,664 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 10:11:46,664 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:46,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,664 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 10:11:46,664 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:46,666 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:46,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,668 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 10:11:46,668 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-06 10:11:46,668 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-06 10:11:46,668 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 10:11:46,668 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-06 10:11:46,668 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-06 10:11:46,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 10:11:46,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:46,669 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 10:11:46,669 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:46,673 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 10:11:46,673 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-06 10:11:46,673 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:11:46,673 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-06 10:11:46,674 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,674 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:46,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:46,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:46,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:46,674 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,674 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:46,675 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,678 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:46,678 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:46,681 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,681 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,681 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:46,681 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:46,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:46,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:46,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:46,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-06 10:11:46,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33dd9887[Count = 1] remaining members to acquire global barrier 2023-10-06 10:11:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:46,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-06 10:11:46,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33dd9887[Count = 0] remaining members to acquire global barrier 2023-10-06 10:11:46,697 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-06 10:11:46,700 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,705 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,705 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,706 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:46,706 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 10:11:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,706 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 10:11:46,706 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-06 10:11:46,706 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:11:46,706 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:11:46,706 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:11:46,706 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:46,706 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:46,706 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:11:46,706 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. started... 2023-10-06 10:11:46,708 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fbbd1fb09a075b1b9aa918037969ab7: 2023-10-06 10:11:46,708 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,708 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 10:11:46,708 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:46,708 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:11:46,708 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-06 10:11:46,710 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:11:46,710 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,710 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 10:11:46,712 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:11:46,713 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:46,713 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:11:46,713 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. started... 2023-10-06 10:11:46,713 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a44aeee528fd15435331bb29e18b6c66: 2023-10-06 10:11:46,713 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:46,715 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:11:46,715 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:11:46,873 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:46,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 10:11:46,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:46,875 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:11:47,177 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:47,177 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. completed. 2023-10-06 10:11:47,177 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:47,178 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:11:47,178 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:11:47,178 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,178 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-06 10:11:47,178 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:11:47,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 10:11:47,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:47,179 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-06 10:11:47,179 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 10:11:47,179 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:47,179 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,179 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-06 10:11:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:11:47,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-06 10:11:47,189 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. completed. 2023-10-06 10:11:47,189 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:47,189 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:11:47,189 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:11:47,189 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,189 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-06 10:11:47,190 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:11:47,191 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 10:11:47,191 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,191 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:47,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:47,191 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-06 10:11:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,44159,1696587032316': 2023-10-06 10:11:47,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-06 10:11:47,201 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-06 10:11:47,202 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:11:47,202 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:11:47,202 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,202 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:11:47,204 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,204 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:47,204 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,204 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:47,204 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,204 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:47,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:47,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:47,205 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:47,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,207 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:47,209 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:47,212 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:47,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,217 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,218 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:47,220 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,232 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:47,232 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:47,232 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:47,232 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:47,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:47,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:47,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:47,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:47,232 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,232 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,232 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,232 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,232 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,233 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:47,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:47,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:47,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:47,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:47,234 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:47,233 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:47,234 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:47,233 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:47,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:47,234 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-06 10:11:47,234 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,234 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:47,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,234 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:47,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:11:47,234 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,234 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:47,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 10:11:47,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,679 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:47,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 10:11:47,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:47,681 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-06 10:11:47,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,694 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-06 10:11:47,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,695 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-06 10:11:47,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696587106568Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696587107665 (+1097 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696587107665Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696587107665Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696587107671 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696587107684 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696587107694 (+10 ms) 2023-10-06 10:11:47,700 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 10:11:47,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.1300 sec 2023-10-06 10:11:48,101 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-06 10:11:48,681 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:48,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 10:11:48,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:11:48,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40269] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:11:48,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44159] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:11:48,690 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-06 10:11:48,690 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:48,690 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:11:48,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 10:11:48,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587108702 (current time:1696587108702). 2023-10-06 10:11:48,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:11:48,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x16e34894 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:11:48,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7af83d02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:11:48,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:48,717 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:48,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16e34894 to 127.0.0.1:65169 2023-10-06 10:11:48,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:11:48,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x0bc76a22 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:11:48,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ec2426, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:11:48,737 DEBUG [hconnection-0x3c4709f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:48,745 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:48,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:11:48,753 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:11:48,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bc76a22 to 127.0.0.1:65169 2023-10-06 10:11:48,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:11:48,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-06 10:11:48,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:11:48,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 10:11:48,762 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:11:48,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 10:11:48,766 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 10:11:48,767 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696587708767 2023-10-06 10:11:48,767 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-06 10:11:48,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 10:11:48,769 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:11:48,769 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:11:48,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 10:11:48,771 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 10:11:48,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-10-06 10:11:48,775 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 10:11:48,777 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696587708777 2023-10-06 10:11:48,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-06 10:11:48,801 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-06 10:11:48,801 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:48,802 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-06 10:11:48,802 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-06 10:11:48,803 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,803 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,805 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:48,805 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:48,805 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:48,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:48,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:48,805 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:48,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:48,806 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,806 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,806 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,806 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:11:48,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-06 10:11:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-06 10:11:48,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 10:11:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,808 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 10:11:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-06 10:11:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,813 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 10:11:48,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-06 10:11:48,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-06 10:11:48,814 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 10:11:48,814 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 10:11:48,814 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:48,814 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:48,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-06 10:11:48,815 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 10:11:48,816 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-06 10:11:48,816 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-06 10:11:48,816 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 10:11:48,817 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:11:48,816 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 10:11:48,818 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 10:11:48,818 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-06 10:11:48,818 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-06 10:11:48,818 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-06 10:11:48,818 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-06 10:11:48,824 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,825 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,825 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,825 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,825 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:48,825 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,825 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,825 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,825 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:48,825 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:48,825 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:11:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:48,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:48,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 10:11:48,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:48,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-06 10:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b91a112[Count = 1] remaining members to acquire global barrier 2023-10-06 10:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:48,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:48,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:48,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 10:11:48,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:48,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:48,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:48,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-06 10:11:48,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b91a112[Count = 0] remaining members to acquire global barrier 2023-10-06 10:11:48,836 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-06 10:11:48,836 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,837 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,837 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,837 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 10:11:48,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,837 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 10:11:48,837 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,838 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:48,838 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:11:48,839 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:48,839 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 10:11:48,839 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-06 10:11:48,839 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:11:48,840 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 10:11:48,840 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:48,840 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-06 10:11:48,841 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:11:48,845 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:48,845 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:11:48,845 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:11:48,845 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:11:48,842 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:48,845 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. started... 2023-10-06 10:11:48,845 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. started... 2023-10-06 10:11:48,845 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a44aeee528fd15435331bb29e18b6c66 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-06 10:11:48,845 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8fbbd1fb09a075b1b9aa918037969ab7 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-06 10:11:48,873 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:48,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 10:11:48,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:48,878 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:11:48,915 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100670f86ade629c4b2892539f3f3de341ce to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100670f86ade629c4b2892539f3f3de341ce 2023-10-06 10:11:48,942 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310069841c37f9abe45b9a680eeb766a5837f to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310069841c37f9abe45b9a680eeb766a5837f 2023-10-06 10:11:48,943 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/.tmp/cf/2dee511e53824f188a8c4585f290307b 2023-10-06 10:11:48,960 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/.tmp/cf/2dee511e53824f188a8c4585f290307b as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/cf/2dee511e53824f188a8c4585f290307b 2023-10-06 10:11:48,967 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/cf/2dee511e53824f188a8c4585f290307b, entries=46, sequenceid=6, filesize=12.5 K 2023-10-06 10:11:48,967 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 8fbbd1fb09a075b1b9aa918037969ab7 in 122ms, sequenceid=6, compaction requested=false 2023-10-06 10:11:48,969 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fbbd1fb09a075b1b9aa918037969ab7: 2023-10-06 10:11:48,969 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-06 10:11:48,969 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:11:48,970 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/cf/2dee511e53824f188a8c4585f290307b] hfiles 2023-10-06 10:11:48,970 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/cf/2dee511e53824f188a8c4585f290307b for snapshot=snaptb0-testConsecutiveExports 2023-10-06 10:11:48,980 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/.tmp/cf/235e3266af184982aecd9c721094f9e7 2023-10-06 10:11:48,991 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/.tmp/cf/235e3266af184982aecd9c721094f9e7 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/cf/235e3266af184982aecd9c721094f9e7 2023-10-06 10:11:48,992 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. completed. 2023-10-06 10:11:48,992 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:11:48,992 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:11:48,993 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:11:48,993 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,993 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-06 10:11:48,993 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:11:48,994 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,994 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 10:11:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:48,995 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:48,995 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-06 10:11:48,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 10:11:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:48,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 10:11:49,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:49,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:49,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,44159,1696587032316': 2023-10-06 10:11:49,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-06 10:11:49,001 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/cf/235e3266af184982aecd9c721094f9e7, entries=4, sequenceid=6, filesize=5.6 K 2023-10-06 10:11:49,008 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for a44aeee528fd15435331bb29e18b6c66 in 163ms, sequenceid=6, compaction requested=false 2023-10-06 10:11:49,008 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a44aeee528fd15435331bb29e18b6c66: 2023-10-06 10:11:49,008 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-06 10:11:49,008 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:11:49,008 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/cf/235e3266af184982aecd9c721094f9e7] hfiles 2023-10-06 10:11:49,008 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/cf/235e3266af184982aecd9c721094f9e7 for snapshot=snaptb0-testConsecutiveExports 2023-10-06 10:11:49,054 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. completed. 2023-10-06 10:11:49,054 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:11:49,054 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:11:49,054 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:11:49,054 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,054 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-06 10:11:49,054 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:11:49,056 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 10:11:49,056 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:49,056 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-06 10:11:49,057 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:49,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:49,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:49,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:49,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 10:11:49,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:49,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 10:11:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:11:49,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-06 10:11:49,065 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-06 10:11:49,065 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:11:49,065 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:11:49,065 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-06 10:11:49,065 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:11:49,068 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,068 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,068 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:49,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:11:49,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:11:49,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,069 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,069 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:49,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:49,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:49,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:11:49,070 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 10:11:49,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,073 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,073 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:49,075 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:49,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:11:49,075 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:49,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 10:11:49,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:49,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:49,078 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:49,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 10:11:49,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:11:49,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:49,082 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:11:49,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:49,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:49,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:11:49,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 10:11:49,087 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,088 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:49,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:49,089 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:49,095 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:49,095 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:49,095 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:49,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:49,095 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:11:49,095 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:49,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:49,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:11:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:11:49,095 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:49,095 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,095 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:11:49,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:49,095 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:49,095 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:11:49,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:49,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:49,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:11:49,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:11:49,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-06 10:11:49,096 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,098 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,098 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:11:49,098 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,098 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:11:49,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-06 10:11:49,098 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:11:49,098 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,098 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-06 10:11:49,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:11:49,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100670f86ade629c4b2892539f3f3de341ce, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310069841c37f9abe45b9a680eeb766a5837f] mob files 2023-10-06 10:11:49,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100670f86ade629c4b2892539f3f3de341ce 2023-10-06 10:11:49,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310069841c37f9abe45b9a680eeb766a5837f 2023-10-06 10:11:49,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-06 10:11:49,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,149 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-06 10:11:49,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,149 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696587108767Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696587109122 (+355 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696587109122Loading Region manifests for snaptb0-testConsecutiveExports at 1696587109123 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1696587109130 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696587109141 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696587109149 (+8 ms) 2023-10-06 10:11:49,152 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 10:11:49,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 385 msec 2023-10-06 10:11:49,382 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:11:49,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 10:11:49,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:11:49,386 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386 2023-10-06 10:11:49,386 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386, srcFsUri=hdfs://localhost:43027, srcDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:11:49,418 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:11:49,418 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6b64cb41, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,418 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae, snapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-06 10:11:49,440 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 10:11:49,463 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:49,464 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:49,464 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:49,465 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:49,772 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0002_000001 (auth:SIMPLE) 2023-10-06 10:11:50,459 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-3603777163331256098.jar 2023-10-06 10:11:50,460 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:50,460 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:50,549 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-516028410078715003.jar 2023-10-06 10:11:50,550 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:50,550 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:50,551 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:50,552 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:50,552 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:50,553 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 10:11:50,553 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 10:11:50,554 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 10:11:50,554 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 10:11:50,555 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 10:11:50,555 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 10:11:50,556 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 10:11:50,556 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 10:11:50,557 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 10:11:50,557 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 10:11:50,558 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 10:11:50,559 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:11:50,559 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:11:50,560 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:11:50,560 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:11:50,561 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:11:50,562 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:11:50,562 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:11:50,890 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 10:11:51,709 WARN [Listener at jenkins-hbase17.apache.org/42055] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 10:11:51,718 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-06 10:11:51,721 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-06 10:11:51,852 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:11:51,853 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:11:52,110 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0003_000001 (auth:SIMPLE) 2023-10-06 10:11:57,721 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0003_000001 (auth:SIMPLE) 2023-10-06 10:11:59,998 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0003_000001 (auth:SIMPLE) 2023-10-06 10:12:04,670 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0003_000001 (auth:SIMPLE) 2023-10-06 10:12:06,156 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 10:12:06,156 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 10:12:06,176 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-06 10:12:06,176 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 10:12:06,177 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 10:12:06,177 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 10:12:06,178 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 10:12:06,178 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 10:12:06,178 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@19887100 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 10:12:06,179 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 10:12:06,179 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 10:12:06,180 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386, srcFsUri=hdfs://localhost:43027, srcDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:12:06,210 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:12:06,211 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3c3cad23, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 10:12:06,211 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae, snapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-06 10:12:06,234 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 10:12:06,254 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:06,254 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:06,255 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:06,255 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:07,228 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-3018265155098699222.jar 2023-10-06 10:12:07,229 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:07,229 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:07,287 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-2032953220398612092.jar 2023-10-06 10:12:07,288 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:07,288 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:07,289 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:07,289 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:07,289 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:07,290 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:07,290 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 10:12:07,290 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 10:12:07,291 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 10:12:07,291 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 10:12:07,291 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 10:12:07,292 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 10:12:07,292 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 10:12:07,292 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 10:12:07,293 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 10:12:07,293 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 10:12:07,294 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:07,294 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:07,294 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:12:07,295 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:07,295 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:07,295 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:12:07,296 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:12:08,277 WARN [Listener at jenkins-hbase17.apache.org/42055] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 10:12:08,279 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-06 10:12:08,286 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-06 10:12:10,900 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:12:10,901 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:12:10,906 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0003_000001 (auth:SIMPLE) 2023-10-06 10:12:11,183 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0004_000001 (auth:SIMPLE) 2023-10-06 10:12:16,662 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0004_000001 (auth:SIMPLE) 2023-10-06 10:12:19,097 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0004_000001 (auth:SIMPLE) 2023-10-06 10:12:26,617 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 10:12:26,618 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 10:12:26,627 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-06 10:12:26,627 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 10:12:26,627 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 10:12:26,627 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 10:12:26,632 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 10:12:26,632 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 10:12:26,632 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@19887100 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 10:12:26,633 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 10:12:26,633 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/local-export-1696587109386/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 10:12:26,657 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-06 10:12:26,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testConsecutiveExports 2023-10-06 10:12:26,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-06 10:12:26,682 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587146681"}]},"ts":"1696587146681"} 2023-10-06 10:12:26,683 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-06 10:12:26,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 10:12:26,687 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-06 10:12:26,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a44aeee528fd15435331bb29e18b6c66, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fbbd1fb09a075b1b9aa918037969ab7, UNASSIGN}] 2023-10-06 10:12:26,692 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a44aeee528fd15435331bb29e18b6c66, UNASSIGN 2023-10-06 10:12:26,694 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fbbd1fb09a075b1b9aa918037969ab7, UNASSIGN 2023-10-06 10:12:26,698 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a44aeee528fd15435331bb29e18b6c66, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:26,698 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587146698"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587146698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587146698"}]},"ts":"1696587146698"} 2023-10-06 10:12:26,698 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8fbbd1fb09a075b1b9aa918037969ab7, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:26,699 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587146698"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587146698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587146698"}]},"ts":"1696587146698"} 2023-10-06 10:12:26,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure a44aeee528fd15435331bb29e18b6c66, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:12:26,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 8fbbd1fb09a075b1b9aa918037969ab7, server=jenkins-hbase17.apache.org,44159,1696587032316}] 2023-10-06 10:12:26,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 10:12:26,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:12:26,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:12:26,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8fbbd1fb09a075b1b9aa918037969ab7, disabling compactions & flushes 2023-10-06 10:12:26,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a44aeee528fd15435331bb29e18b6c66, disabling compactions & flushes 2023-10-06 10:12:26,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:12:26,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:12:26,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:12:26,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:12:26,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. after waiting 0 ms 2023-10-06 10:12:26,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. after waiting 0 ms 2023-10-06 10:12:26,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:12:26,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:12:26,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:12:26,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:12:26,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66. 2023-10-06 10:12:26,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a44aeee528fd15435331bb29e18b6c66: 2023-10-06 10:12:26,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:12:26,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:12:26,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7. 2023-10-06 10:12:26,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8fbbd1fb09a075b1b9aa918037969ab7: 2023-10-06 10:12:26,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:12:26,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a44aeee528fd15435331bb29e18b6c66, regionState=CLOSED 2023-10-06 10:12:26,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587146888"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587146888"}]},"ts":"1696587146888"} 2023-10-06 10:12:26,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:12:26,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8fbbd1fb09a075b1b9aa918037969ab7, regionState=CLOSED 2023-10-06 10:12:26,892 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696587146892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587146892"}]},"ts":"1696587146892"} 2023-10-06 10:12:26,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-06 10:12:26,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure a44aeee528fd15435331bb29e18b6c66, server=jenkins-hbase17.apache.org,40269,1696587032407 in 185 msec 2023-10-06 10:12:26,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-06 10:12:26,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 8fbbd1fb09a075b1b9aa918037969ab7, server=jenkins-hbase17.apache.org,44159,1696587032316 in 188 msec 2023-10-06 10:12:26,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a44aeee528fd15435331bb29e18b6c66, UNASSIGN in 205 msec 2023-10-06 10:12:26,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-06 10:12:26,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8fbbd1fb09a075b1b9aa918037969ab7, UNASSIGN in 206 msec 2023-10-06 10:12:26,898 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587146898"}]},"ts":"1696587146898"} 2023-10-06 10:12:26,900 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-06 10:12:26,986 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-06 10:12:26,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 10:12:26,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 322 msec 2023-10-06 10:12:27,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 10:12:27,288 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-06 10:12:27,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testConsecutiveExports 2023-10-06 10:12:27,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 10:12:27,291 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 10:12:27,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-06 10:12:27,292 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 10:12:27,295 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-06 10:12:27,300 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:12:27,300 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:12:27,302 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/recovered.edits] 2023-10-06 10:12:27,302 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/recovered.edits] 2023-10-06 10:12:27,306 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/cf/235e3266af184982aecd9c721094f9e7 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/cf/235e3266af184982aecd9c721094f9e7 2023-10-06 10:12:27,306 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/cf/2dee511e53824f188a8c4585f290307b to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/cf/2dee511e53824f188a8c4585f290307b 2023-10-06 10:12:27,309 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66/recovered.edits/9.seqid 2023-10-06 10:12:27,309 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7/recovered.edits/9.seqid 2023-10-06 10:12:27,310 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/a44aeee528fd15435331bb29e18b6c66 2023-10-06 10:12:27,310 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testConsecutiveExports/8fbbd1fb09a075b1b9aa918037969ab7 2023-10-06 10:12:27,310 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-06 10:12:27,310 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-06 10:12:27,311 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-06 10:12:27,314 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100670f86ade629c4b2892539f3f3de341ce to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100670f86ade629c4b2892539f3f3de341ce 2023-10-06 10:12:27,315 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310069841c37f9abe45b9a680eeb766a5837f to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310069841c37f9abe45b9a680eeb766a5837f 2023-10-06 10:12:27,316 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-06 10:12:27,318 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 10:12:27,320 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-06 10:12:27,321 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-06 10:12:27,323 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 10:12:27,323 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-06 10:12:27,323 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587147323"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:27,323 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587147323"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:27,324 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 10:12:27,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a44aeee528fd15435331bb29e18b6c66, NAME => 'testtb-testConsecutiveExports,,1696587105761.a44aeee528fd15435331bb29e18b6c66.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8fbbd1fb09a075b1b9aa918037969ab7, NAME => 'testtb-testConsecutiveExports,1,1696587105761.8fbbd1fb09a075b1b9aa918037969ab7.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 10:12:27,324 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-06 10:12:27,325 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696587147324"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:27,326 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-06 10:12:27,478 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 10:12:27,479 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 10:12:27,479 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 10:12:27,484 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 10:12:27,484 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 10:12:27,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 190 msec 2023-10-06 10:12:27,485 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 10:12:27,485 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 10:12:27,486 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:27,486 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:27,486 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-10-06 10:12:27,486 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 10:12:27,486 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:27,486 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 10:12:27,486 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-10-06 10:12:27,486 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:27,486 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 10:12:27,486 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 10:12:27,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-06 10:12:27,488 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-06 10:12:27,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-06 10:12:27,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-06 10:12:27,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testConsecutiveExports" 2023-10-06 10:12:27,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-06 10:12:27,549 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=743 (was 746), OpenFileDescriptor=898 (was 910), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=848 (was 968), ProcessCount=195 (was 192) - ProcessCount LEAK? -, AvailableMemoryMB=849 (was 2558) 2023-10-06 10:12:27,549 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-10-06 10:12:27,577 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=743, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=848, ProcessCount=195, AvailableMemoryMB=848 2023-10-06 10:12:27,577 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-10-06 10:12:27,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 10:12:27,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:27,584 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 10:12:27,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-06 10:12:27,588 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 10:12:27,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 10:12:27,591 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:27,593 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:27,593 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead empty. 2023-10-06 10:12:27,594 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:27,594 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c empty. 2023-10-06 10:12:27,595 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:27,595 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-06 10:12:27,665 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-06 10:12:27,666 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2282a2906c9867767b6c5bacfcf5bead, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:12:27,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 32c583eaca86f440ba360807e17b379c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:12:27,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 10:12:27,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:27,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 2282a2906c9867767b6c5bacfcf5bead, disabling compactions & flushes 2023-10-06 10:12:27,713 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:27,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:27,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. after waiting 0 ms 2023-10-06 10:12:27,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:27,713 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:27,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 2282a2906c9867767b6c5bacfcf5bead: 2023-10-06 10:12:27,753 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:27,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 32c583eaca86f440ba360807e17b379c, disabling compactions & flushes 2023-10-06 10:12:27,755 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:27,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:27,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. after waiting 0 ms 2023-10-06 10:12:27,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:27,755 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:27,755 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 32c583eaca86f440ba360807e17b379c: 2023-10-06 10:12:27,758 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 10:12:27,759 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587147759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587147759"}]},"ts":"1696587147759"} 2023-10-06 10:12:27,760 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587147759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587147759"}]},"ts":"1696587147759"} 2023-10-06 10:12:27,768 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 10:12:27,769 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 10:12:27,769 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587147769"}]},"ts":"1696587147769"} 2023-10-06 10:12:27,773 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-06 10:12:27,778 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:12:27,780 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:12:27,780 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:12:27,780 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:12:27,780 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:12:27,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2282a2906c9867767b6c5bacfcf5bead, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=32c583eaca86f440ba360807e17b379c, ASSIGN}] 2023-10-06 10:12:27,786 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=32c583eaca86f440ba360807e17b379c, ASSIGN 2023-10-06 10:12:27,786 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2282a2906c9867767b6c5bacfcf5bead, ASSIGN 2023-10-06 10:12:27,788 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=32c583eaca86f440ba360807e17b379c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44159,1696587032316; forceNewPlan=false, retain=false 2023-10-06 10:12:27,788 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2282a2906c9867767b6c5bacfcf5bead, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40269,1696587032407; forceNewPlan=false, retain=false 2023-10-06 10:12:27,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 10:12:27,938 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 10:12:27,941 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2282a2906c9867767b6c5bacfcf5bead, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:27,941 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=32c583eaca86f440ba360807e17b379c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:27,942 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587147941"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587147941"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587147941"}]},"ts":"1696587147941"} 2023-10-06 10:12:27,942 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587147941"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587147941"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587147941"}]},"ts":"1696587147941"} 2023-10-06 10:12:27,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 2282a2906c9867767b6c5bacfcf5bead, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:12:27,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 32c583eaca86f440ba360807e17b379c, server=jenkins-hbase17.apache.org,44159,1696587032316}] 2023-10-06 10:12:28,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:28,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2282a2906c9867767b6c5bacfcf5bead, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 10:12:28,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. service=AccessControlService 2023-10-06 10:12:28,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:12:28,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:28,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:28,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:28,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:28,105 INFO [StoreOpener-2282a2906c9867767b6c5bacfcf5bead-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:28,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:28,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 32c583eaca86f440ba360807e17b379c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 10:12:28,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. service=AccessControlService 2023-10-06 10:12:28,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:12:28,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:28,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:28,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:28,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:28,108 DEBUG [StoreOpener-2282a2906c9867767b6c5bacfcf5bead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/cf 2023-10-06 10:12:28,108 DEBUG [StoreOpener-2282a2906c9867767b6c5bacfcf5bead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/cf 2023-10-06 10:12:28,109 INFO [StoreOpener-32c583eaca86f440ba360807e17b379c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:28,109 INFO [StoreOpener-2282a2906c9867767b6c5bacfcf5bead-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2282a2906c9867767b6c5bacfcf5bead columnFamilyName cf 2023-10-06 10:12:28,111 INFO [StoreOpener-2282a2906c9867767b6c5bacfcf5bead-1] regionserver.HStore(310): Store=2282a2906c9867767b6c5bacfcf5bead/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:12:28,111 DEBUG [StoreOpener-32c583eaca86f440ba360807e17b379c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/cf 2023-10-06 10:12:28,112 DEBUG [StoreOpener-32c583eaca86f440ba360807e17b379c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/cf 2023-10-06 10:12:28,113 INFO [StoreOpener-32c583eaca86f440ba360807e17b379c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32c583eaca86f440ba360807e17b379c columnFamilyName cf 2023-10-06 10:12:28,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:28,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:28,114 INFO [StoreOpener-32c583eaca86f440ba360807e17b379c-1] regionserver.HStore(310): Store=32c583eaca86f440ba360807e17b379c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:12:28,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:28,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:28,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:28,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:28,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:12:28,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:12:28,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2282a2906c9867767b6c5bacfcf5bead; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66593001, jitterRate=-0.0076869577169418335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:12:28,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2282a2906c9867767b6c5bacfcf5bead: 2023-10-06 10:12:28,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 32c583eaca86f440ba360807e17b379c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62250079, jitterRate=-0.07240153849124908}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:12:28,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 32c583eaca86f440ba360807e17b379c: 2023-10-06 10:12:28,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c., pid=61, masterSystemTime=1696587148100 2023-10-06 10:12:28,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead., pid=60, masterSystemTime=1696587148099 2023-10-06 10:12:28,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:28,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:28,137 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=32c583eaca86f440ba360807e17b379c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,138 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587148137"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587148137"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587148137"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587148137"}]},"ts":"1696587148137"} 2023-10-06 10:12:28,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:28,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:28,138 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2282a2906c9867767b6c5bacfcf5bead, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:28,140 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587148138"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587148138"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587148138"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587148138"}]},"ts":"1696587148138"} 2023-10-06 10:12:28,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-06 10:12:28,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 32c583eaca86f440ba360807e17b379c, server=jenkins-hbase17.apache.org,44159,1696587032316 in 195 msec 2023-10-06 10:12:28,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-06 10:12:28,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 2282a2906c9867767b6c5bacfcf5bead, server=jenkins-hbase17.apache.org,40269,1696587032407 in 198 msec 2023-10-06 10:12:28,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=32c583eaca86f440ba360807e17b379c, ASSIGN in 364 msec 2023-10-06 10:12:28,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-06 10:12:28,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2282a2906c9867767b6c5bacfcf5bead, ASSIGN in 367 msec 2023-10-06 10:12:28,150 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 10:12:28,150 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587148150"}]},"ts":"1696587148150"} 2023-10-06 10:12:28,152 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-06 10:12:28,155 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 10:12:28,155 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-06 10:12:28,157 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-06 10:12:28,158 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:28,158 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:28,158 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:28,158 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:28,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:28,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:28,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:28,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:28,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 580 msec 2023-10-06 10:12:28,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 10:12:28,200 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-06 10:12:28,203 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,203 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:28,205 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:12:28,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 10:12:28,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587148224 (current time:1696587148224). 2023-10-06 10:12:28,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:12:28,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x48c489cb to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:28,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@752e2bba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:28,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:28,244 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:28,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48c489cb to 127.0.0.1:65169 2023-10-06 10:12:28,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:28,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x6519b082 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:28,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9ffe73b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:28,285 DEBUG [hconnection-0xd086e45-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:28,287 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:28,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:28,295 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:28,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6519b082 to 127.0.0.1:65169 2023-10-06 10:12:28,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:28,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-06 10:12:28,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:12:28,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 10:12:28,303 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:12:28,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 10:12:28,313 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 10:12:28,317 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696587748317 2023-10-06 10:12:28,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 10:12:28,319 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:12:28,319 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:12:28,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 10:12:28,321 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 10:12:28,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 17 msec 2023-10-06 10:12:28,323 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 10:12:28,324 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696587748324 2023-10-06 10:12:28,419 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:28,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 10:12:28,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:28,421 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:12:28,621 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:28,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 10:12:28,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:28,623 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:12:28,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,745 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-06 10:12:28,745 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:28,745 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-06 10:12:28,745 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-06 10:12:28,746 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,746 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,747 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:28,747 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:28,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:28,748 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:28,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:28,748 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:28,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,749 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:28,749 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,750 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,750 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:12:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-06 10:12:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 10:12:28,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,751 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 10:12:28,751 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:28,752 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 10:12:28,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-06 10:12:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 10:12:28,752 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 10:12:28,753 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 10:12:28,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,754 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 10:12:28,754 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:28,755 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 10:12:28,755 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 10:12:28,755 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 10:12:28,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-06 10:12:28,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,756 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 10:12:28,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,757 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 10:12:28,757 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:28,762 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 10:12:28,762 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 10:12:28,762 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 10:12:28,768 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,769 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,769 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,769 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:28,773 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:28,773 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,773 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,774 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,774 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:28,775 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,775 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:28,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 10:12:28,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57a57e54[Count = 1] remaining members to acquire global barrier 2023-10-06 10:12:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:28,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 10:12:28,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57a57e54[Count = 0] remaining members to acquire global barrier 2023-10-06 10:12:28,780 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-06 10:12:28,780 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,781 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,781 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,781 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 10:12:28,781 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:12:28,781 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:12:28,781 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:28,782 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,782 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:12:28,781 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,781 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:28,782 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. started... 2023-10-06 10:12:28,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,782 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 10:12:28,782 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 10:12:28,784 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 32c583eaca86f440ba360807e17b379c: 2023-10-06 10:12:28,784 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 10:12:28,784 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:12:28,784 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,784 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:12:28,784 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:12:28,786 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:12:28,786 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:12:28,786 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:28,787 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. started... 2023-10-06 10:12:28,787 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2282a2906c9867767b6c5bacfcf5bead: 2023-10-06 10:12:28,787 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,787 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:12:28,787 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:12:28,793 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 10:12:28,793 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:28,794 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 10:12:28,839 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. completed. 2023-10-06 10:12:28,840 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:28,840 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:12:28,840 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:12:28,840 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,840 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 10:12:28,840 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:12:28,842 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 10:12:28,842 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,842 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:28,842 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 10:12:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:28,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:28,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:28,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:28,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:28,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:28,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:28,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:28,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,44159,1696587032316': 2023-10-06 10:12:28,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-06 10:12:28,923 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:28,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 10:12:28,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:28,925 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-06 10:12:29,218 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. completed. 2023-10-06 10:12:29,218 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:29,219 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:12:29,219 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:12:29,219 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,219 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 10:12:29,219 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:12:29,220 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,220 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 10:12:29,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:29,220 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:29,221 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 10:12:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:29,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:29,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:12:29,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-06 10:12:29,227 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-06 10:12:29,227 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:12:29,227 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:12:29,227 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,228 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:12:29,230 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:29,230 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:29,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,230 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:29,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:29,231 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:29,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:29,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:29,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:29,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:29,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:29,231 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,232 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:29,234 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,234 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,234 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,237 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,237 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,237 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,237 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,237 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,237 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:29,237 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:29,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:29,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:29,237 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:29,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:29,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:29,237 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:29,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:29,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:29,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:29,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:29,239 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,239 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,239 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,239 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:29,239 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:29,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,239 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:12:29,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:29,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:29,239 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:29,241 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,241 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 10:12:29,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:29,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-06 10:12:29,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,357 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696587148317Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696587149265 (+948 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696587149265Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696587149265Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696587149282 (+17 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696587149330 (+48 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696587149356 (+26 ms) 2023-10-06 10:12:29,360 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 10:12:29,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.0410 sec 2023-10-06 10:12:29,425 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:29,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 10:12:29,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:12:29,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40269] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:12:29,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44159] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:12:29,444 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,444 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:29,444 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:12:29,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 10:12:29,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587149470 (current time:1696587149470). 2023-10-06 10:12:29,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:12:29,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x64ba7127 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:29,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c7ece8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:29,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:29,505 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:29,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64ba7127 to 127.0.0.1:65169 2023-10-06 10:12:29,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:29,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x53fa798b to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:29,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64fe099a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:29,525 DEBUG [hconnection-0x6efea92e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:29,530 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:29,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:29,538 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:29,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53fa798b to 127.0.0.1:65169 2023-10-06 10:12:29,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:29,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-06 10:12:29,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:12:29,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 10:12:29,544 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:12:29,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 10:12:29,547 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 10:12:29,548 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696587749548 2023-10-06 10:12:29,548 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 10:12:29,550 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:12:29,550 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:12:29,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 10:12:29,551 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 10:12:29,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-10-06 10:12:29,561 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 10:12:29,573 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696587749573 2023-10-06 10:12:29,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,595 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-06 10:12:29,595 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:29,598 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-06 10:12:29,598 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-06 10:12:29,601 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,602 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,605 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:29,605 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:29,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:29,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:29,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:29,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,606 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:29,606 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:29,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-06 10:12:29,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-06 10:12:29,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 10:12:29,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 10:12:29,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,607 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,607 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,607 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 10:12:29,608 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:29,607 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 10:12:29,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,609 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 10:12:29,609 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 10:12:29,608 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,609 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:12:29,609 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 10:12:29,609 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:29,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-06 10:12:29,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,609 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 10:12:29,610 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,610 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 10:12:29,610 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:29,611 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 10:12:29,611 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 10:12:29,611 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 10:12:29,611 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 10:12:29,611 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 10:12:29,611 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,611 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:29,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:29,611 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 10:12:29,612 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,612 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:29,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:29,613 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,617 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,617 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:29,617 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,617 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:29,617 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,617 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:29,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:29,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 10:12:29,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b503b35[Count = 1] remaining members to acquire global barrier 2023-10-06 10:12:29,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:29,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:29,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:29,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:29,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:29,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 10:12:29,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b503b35[Count = 0] remaining members to acquire global barrier 2023-10-06 10:12:29,625 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-06 10:12:29,625 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,626 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,626 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,626 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 10:12:29,626 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:12:29,626 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:12:29,627 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:29,627 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. started... 2023-10-06 10:12:29,627 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 32c583eaca86f440ba360807e17b379c 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-06 10:12:29,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,627 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 10:12:29,627 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 10:12:29,627 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:12:29,629 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,629 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 10:12:29,629 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:29,629 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 10:12:29,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,629 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 10:12:29,630 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:12:29,630 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,630 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:29,630 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:12:29,630 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. started... 2023-10-06 10:12:29,630 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,630 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:12:29,630 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2282a2906c9867767b6c5bacfcf5bead 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-06 10:12:29,650 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:29,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 10:12:29,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:29,651 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:12:29,684 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310061b981c1b4d86490a9f9a3c4540076d59 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310061b981c1b4d86490a9f9a3c4540076d59 2023-10-06 10:12:29,695 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310066d22fa237d864defa71bcde77d32a134 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310066d22fa237d864defa71bcde77d32a134 2023-10-06 10:12:29,715 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/.tmp/cf/7d4ae2c547fa42c5b4746b4b4727b436 2023-10-06 10:12:29,722 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/.tmp/cf/7d4ae2c547fa42c5b4746b4b4727b436 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/cf/7d4ae2c547fa42c5b4746b4b4727b436 2023-10-06 10:12:29,728 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/cf/7d4ae2c547fa42c5b4746b4b4727b436, entries=4, sequenceid=6, filesize=5.6 K 2023-10-06 10:12:29,728 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 2282a2906c9867767b6c5bacfcf5bead in 98ms, sequenceid=6, compaction requested=false 2023-10-06 10:12:29,728 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-06 10:12:29,729 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2282a2906c9867767b6c5bacfcf5bead: 2023-10-06 10:12:29,729 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,729 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:12:29,729 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/cf/7d4ae2c547fa42c5b4746b4b4727b436] hfiles 2023-10-06 10:12:29,729 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/cf/7d4ae2c547fa42c5b4746b4b4727b436 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,730 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/.tmp/cf/5b6c3f62672a49cebcba24ebcff9be72 2023-10-06 10:12:29,741 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/.tmp/cf/5b6c3f62672a49cebcba24ebcff9be72 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/cf/5b6c3f62672a49cebcba24ebcff9be72 2023-10-06 10:12:29,752 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/cf/5b6c3f62672a49cebcba24ebcff9be72, entries=46, sequenceid=6, filesize=13.4 K 2023-10-06 10:12:29,753 INFO [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 32c583eaca86f440ba360807e17b379c in 126ms, sequenceid=6, compaction requested=false 2023-10-06 10:12:29,755 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 32c583eaca86f440ba360807e17b379c: 2023-10-06 10:12:29,755 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,755 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:12:29,755 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/cf/5b6c3f62672a49cebcba24ebcff9be72] hfiles 2023-10-06 10:12:29,755 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/cf/5b6c3f62672a49cebcba24ebcff9be72 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,777 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. completed. 2023-10-06 10:12:29,777 DEBUG [rs(jenkins-hbase17.apache.org,44159,1696587032316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:29,778 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:12:29,779 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:12:29,779 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,779 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 10:12:29,780 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:12:29,781 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 10:12:29,781 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:29,781 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 10:12:29,782 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:29,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:29,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:29,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:29,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:29,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,44159,1696587032316': 2023-10-06 10:12:29,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-06 10:12:29,851 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:29,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 10:12:29,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:29,853 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:12:30,142 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. completed. 2023-10-06 10:12:30,142 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:30,142 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:12:30,142 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:12:30,142 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,142 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 10:12:30,142 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:12:30,145 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,145 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 10:12:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,145 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:30,145 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 10:12:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-06 10:12:30,150 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-06 10:12:30,150 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:12:30,151 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:12:30,151 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,151 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:12:30,152 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:30,152 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:30,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,152 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:30,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:30,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:30,153 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:30,153 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,153 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:30,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:30,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 10:12:30,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:30,154 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-06 10:12:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:30,157 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:30,158 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,158 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:30,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:30,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:30,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,161 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:30,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:30,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:30,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:30,161 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:30,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:30,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:30,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:30,164 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,164 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:30,164 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:30,164 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:30,164 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:30,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:30,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310066d22fa237d864defa71bcde77d32a134, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310061b981c1b4d86490a9f9a3c4540076d59] mob files 2023-10-06 10:12:30,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310066d22fa237d864defa71bcde77d32a134 2023-10-06 10:12:30,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310061b981c1b4d86490a9f9a3c4540076d59 2023-10-06 10:12:30,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-06 10:12:30,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,621 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:30,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696587149548Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696587150183 (+635 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696587150183Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696587150183Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696587150189 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696587150604 (+415 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696587150620 (+16 ms) 2023-10-06 10:12:30,623 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 10:12:30,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.0740 sec 2023-10-06 10:12:30,654 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:30,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 10:12:30,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:12:30,696 DEBUG [Listener at jenkins-hbase17.apache.org/42055] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 10:12:30,703 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 10:12:30,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-06 10:12:30,706 DEBUG [Listener at jenkins-hbase17.apache.org/42055] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 10:12:30,709 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 10:12:30,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40269] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-06 10:12:30,710 DEBUG [Listener at jenkins-hbase17.apache.org/42055] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 10:12:30,714 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 10:12:30,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44159] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-06 10:12:30,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-06 10:12:30,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:30,725 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 10:12:30,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-06 10:12:30,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 10:12:30,728 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 10:12:30,731 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:30,731 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:30,732 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700 empty. 2023-10-06 10:12:30,732 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76 empty. 2023-10-06 10:12:30,733 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:30,733 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:30,733 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-06 10:12:30,748 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-06 10:12:30,749 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => bdfeefed792ff48c045b7d3cf7caa700, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:12:30,749 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => e27f94ac5f2613e4c9aaa42251328c76, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:12:30,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:30,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing bdfeefed792ff48c045b7d3cf7caa700, disabling compactions & flushes 2023-10-06 10:12:30,768 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:30,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:30,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. after waiting 0 ms 2023-10-06 10:12:30,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:30,768 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:30,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for bdfeefed792ff48c045b7d3cf7caa700: 2023-10-06 10:12:30,773 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:30,774 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing e27f94ac5f2613e4c9aaa42251328c76, disabling compactions & flushes 2023-10-06 10:12:30,774 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:30,775 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:30,775 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. after waiting 0 ms 2023-10-06 10:12:30,775 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:30,775 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:30,775 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for e27f94ac5f2613e4c9aaa42251328c76: 2023-10-06 10:12:30,777 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 10:12:30,778 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587150778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587150778"}]},"ts":"1696587150778"} 2023-10-06 10:12:30,778 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587150778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587150778"}]},"ts":"1696587150778"} 2023-10-06 10:12:30,781 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 10:12:30,782 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 10:12:30,782 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587150782"}]},"ts":"1696587150782"} 2023-10-06 10:12:30,783 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-06 10:12:30,785 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:12:30,787 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:12:30,787 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:12:30,787 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:12:30,787 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:12:30,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bdfeefed792ff48c045b7d3cf7caa700, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e27f94ac5f2613e4c9aaa42251328c76, ASSIGN}] 2023-10-06 10:12:30,790 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e27f94ac5f2613e4c9aaa42251328c76, ASSIGN 2023-10-06 10:12:30,790 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bdfeefed792ff48c045b7d3cf7caa700, ASSIGN 2023-10-06 10:12:30,792 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bdfeefed792ff48c045b7d3cf7caa700, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36349,1696587032478; forceNewPlan=false, retain=false 2023-10-06 10:12:30,792 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e27f94ac5f2613e4c9aaa42251328c76, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40269,1696587032407; forceNewPlan=false, retain=false 2023-10-06 10:12:30,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 10:12:30,942 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 10:12:30,946 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=e27f94ac5f2613e4c9aaa42251328c76, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:30,946 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bdfeefed792ff48c045b7d3cf7caa700, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:30,946 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587150946"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587150946"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587150946"}]},"ts":"1696587150946"} 2023-10-06 10:12:30,947 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587150946"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587150946"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587150946"}]},"ts":"1696587150946"} 2023-10-06 10:12:30,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure e27f94ac5f2613e4c9aaa42251328c76, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:12:30,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure bdfeefed792ff48c045b7d3cf7caa700, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:12:31,012 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0004_000001 (auth:SIMPLE) 2023-10-06 10:12:31,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 10:12:31,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:31,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e27f94ac5f2613e4c9aaa42251328c76, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.', STARTKEY => '2', ENDKEY => ''} 2023-10-06 10:12:31,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. service=AccessControlService 2023-10-06 10:12:31,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:12:31,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:31,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:31,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bdfeefed792ff48c045b7d3cf7caa700, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.', STARTKEY => '', ENDKEY => '2'} 2023-10-06 10:12:31,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. service=AccessControlService 2023-10-06 10:12:31,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:12:31,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:31,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:31,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:31,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:31,113 INFO [StoreOpener-e27f94ac5f2613e4c9aaa42251328c76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,114 INFO [StoreOpener-bdfeefed792ff48c045b7d3cf7caa700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:31,114 DEBUG [StoreOpener-e27f94ac5f2613e4c9aaa42251328c76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/cf 2023-10-06 10:12:31,115 DEBUG [StoreOpener-e27f94ac5f2613e4c9aaa42251328c76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/cf 2023-10-06 10:12:31,115 INFO [StoreOpener-e27f94ac5f2613e4c9aaa42251328c76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e27f94ac5f2613e4c9aaa42251328c76 columnFamilyName cf 2023-10-06 10:12:31,117 INFO [StoreOpener-e27f94ac5f2613e4c9aaa42251328c76-1] regionserver.HStore(310): Store=e27f94ac5f2613e4c9aaa42251328c76/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:12:31,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,121 DEBUG [StoreOpener-bdfeefed792ff48c045b7d3cf7caa700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/cf 2023-10-06 10:12:31,121 DEBUG [StoreOpener-bdfeefed792ff48c045b7d3cf7caa700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/cf 2023-10-06 10:12:31,121 INFO [StoreOpener-bdfeefed792ff48c045b7d3cf7caa700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdfeefed792ff48c045b7d3cf7caa700 columnFamilyName cf 2023-10-06 10:12:31,122 INFO [StoreOpener-bdfeefed792ff48c045b7d3cf7caa700-1] regionserver.HStore(310): Store=bdfeefed792ff48c045b7d3cf7caa700/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:12:31,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:31,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:31,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:31,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:12:31,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:12:31,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e27f94ac5f2613e4c9aaa42251328c76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71645432, jitterRate=0.06760013103485107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:12:31,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e27f94ac5f2613e4c9aaa42251328c76: 2023-10-06 10:12:31,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened bdfeefed792ff48c045b7d3cf7caa700; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75412898, jitterRate=0.12373974919319153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:12:31,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for bdfeefed792ff48c045b7d3cf7caa700: 2023-10-06 10:12:31,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76., pid=69, masterSystemTime=1696587151103 2023-10-06 10:12:31,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:31,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:31,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=e27f94ac5f2613e4c9aaa42251328c76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:31,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587151139"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587151139"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587151139"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587151139"}]},"ts":"1696587151139"} 2023-10-06 10:12:31,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700., pid=70, masterSystemTime=1696587151104 2023-10-06 10:12:31,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:31,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:31,146 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bdfeefed792ff48c045b7d3cf7caa700, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:31,148 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587151146"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587151146"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587151146"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587151146"}]},"ts":"1696587151146"} 2023-10-06 10:12:31,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-06 10:12:31,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure e27f94ac5f2613e4c9aaa42251328c76, server=jenkins-hbase17.apache.org,40269,1696587032407 in 190 msec 2023-10-06 10:12:31,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e27f94ac5f2613e4c9aaa42251328c76, ASSIGN in 364 msec 2023-10-06 10:12:31,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-06 10:12:31,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure bdfeefed792ff48c045b7d3cf7caa700, server=jenkins-hbase17.apache.org,36349,1696587032478 in 198 msec 2023-10-06 10:12:31,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-06 10:12:31,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bdfeefed792ff48c045b7d3cf7caa700, ASSIGN in 371 msec 2023-10-06 10:12:31,162 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 10:12:31,163 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587151163"}]},"ts":"1696587151163"} 2023-10-06 10:12:31,164 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-06 10:12:31,166 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 10:12:31,167 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-06 10:12:31,169 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-06 10:12:31,173 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:31,173 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:31,173 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:31,173 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:31,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 458 msec 2023-10-06 10:12:31,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:31,182 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:31,182 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:31,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:31,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:31,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:31,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:31,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:31,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 10:12:31,335 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-06 10:12:31,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$2(1952): Client=jenkins//136.243.18.41 merge regions bdfeefed792ff48c045b7d3cf7caa700, e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bdfeefed792ff48c045b7d3cf7caa700, e27f94ac5f2613e4c9aaa42251328c76], force=true 2023-10-06 10:12:31,419 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bdfeefed792ff48c045b7d3cf7caa700, e27f94ac5f2613e4c9aaa42251328c76], force=true 2023-10-06 10:12:31,419 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bdfeefed792ff48c045b7d3cf7caa700, e27f94ac5f2613e4c9aaa42251328c76], force=true 2023-10-06 10:12:31,420 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bdfeefed792ff48c045b7d3cf7caa700, e27f94ac5f2613e4c9aaa42251328c76], force=true 2023-10-06 10:12:31,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 10:12:31,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bdfeefed792ff48c045b7d3cf7caa700, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e27f94ac5f2613e4c9aaa42251328c76, UNASSIGN}] 2023-10-06 10:12:31,488 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e27f94ac5f2613e4c9aaa42251328c76, UNASSIGN 2023-10-06 10:12:31,490 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bdfeefed792ff48c045b7d3cf7caa700, UNASSIGN 2023-10-06 10:12:31,499 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=e27f94ac5f2613e4c9aaa42251328c76, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:31,499 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587151498"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587151498"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587151498"}]},"ts":"1696587151498"} 2023-10-06 10:12:31,500 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bdfeefed792ff48c045b7d3cf7caa700, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:31,500 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587151500"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587151500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587151500"}]},"ts":"1696587151500"} 2023-10-06 10:12:31,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure e27f94ac5f2613e4c9aaa42251328c76, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:12:31,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure bdfeefed792ff48c045b7d3cf7caa700, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:12:31,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 10:12:31,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e27f94ac5f2613e4c9aaa42251328c76, disabling compactions & flushes 2023-10-06 10:12:31,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:31,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:31,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. after waiting 0 ms 2023-10-06 10:12:31,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:31,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing e27f94ac5f2613e4c9aaa42251328c76 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-06 10:12:31,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:31,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing bdfeefed792ff48c045b7d3cf7caa700, disabling compactions & flushes 2023-10-06 10:12:31,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:31,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:31,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. after waiting 0 ms 2023-10-06 10:12:31,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:31,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing bdfeefed792ff48c045b7d3cf7caa700 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-06 10:12:31,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/.tmp/cf/1b069e5ae7944774a324511c829ba0e3 2023-10-06 10:12:31,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 10:12:31,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/.tmp/cf/1b069e5ae7944774a324511c829ba0e3 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/cf/1b069e5ae7944774a324511c829ba0e3 2023-10-06 10:12:31,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/.tmp/cf/fb87439f73384762b4db46e15d98d4be 2023-10-06 10:12:31,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/cf/1b069e5ae7944774a324511c829ba0e3, entries=1, sequenceid=5, filesize=4.7 K 2023-10-06 10:12:31,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e27f94ac5f2613e4c9aaa42251328c76 in 92ms, sequenceid=5, compaction requested=false 2023-10-06 10:12:31,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-06 10:12:31,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/.tmp/cf/fb87439f73384762b4db46e15d98d4be as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/cf/fb87439f73384762b4db46e15d98d4be 2023-10-06 10:12:31,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/cf/fb87439f73384762b4db46e15d98d4be, entries=1, sequenceid=5, filesize=4.7 K 2023-10-06 10:12:31,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for bdfeefed792ff48c045b7d3cf7caa700 in 114ms, sequenceid=5, compaction requested=false 2023-10-06 10:12:31,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-06 10:12:31,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:12:31,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76. 2023-10-06 10:12:31,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e27f94ac5f2613e4c9aaa42251328c76: 2023-10-06 10:12:31,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-06 10:12:31,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:12:31,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700. 2023-10-06 10:12:31,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for bdfeefed792ff48c045b7d3cf7caa700: 2023-10-06 10:12:31,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:31,822 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=e27f94ac5f2613e4c9aaa42251328c76, regionState=CLOSED 2023-10-06 10:12:31,822 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587151821"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587151821"}]},"ts":"1696587151821"} 2023-10-06 10:12:31,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:31,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bdfeefed792ff48c045b7d3cf7caa700, regionState=CLOSED 2023-10-06 10:12:31,826 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696587151826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587151826"}]},"ts":"1696587151826"} 2023-10-06 10:12:31,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-06 10:12:31,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure e27f94ac5f2613e4c9aaa42251328c76, server=jenkins-hbase17.apache.org,40269,1696587032407 in 315 msec 2023-10-06 10:12:31,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e27f94ac5f2613e4c9aaa42251328c76, UNASSIGN in 346 msec 2023-10-06 10:12:31,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-06 10:12:31,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure bdfeefed792ff48c045b7d3cf7caa700, server=jenkins-hbase17.apache.org,36349,1696587032478 in 313 msec 2023-10-06 10:12:31,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-06 10:12:31,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bdfeefed792ff48c045b7d3cf7caa700, UNASSIGN in 356 msec 2023-10-06 10:12:32,018 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-06 10:12:32,020 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150716.bdfeefed792ff48c045b7d3cf7caa700.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:32,020 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696587150716.e27f94ac5f2613e4c9aaa42251328c76.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:32,020 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:32,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 10:12:32,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01f7bd606718ce5b087d4643001d5cbe, ASSIGN}] 2023-10-06 10:12:32,086 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01f7bd606718ce5b087d4643001d5cbe, ASSIGN 2023-10-06 10:12:32,087 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01f7bd606718ce5b087d4643001d5cbe, ASSIGN; state=MERGED, location=jenkins-hbase17.apache.org,36349,1696587032478; forceNewPlan=false, retain=false 2023-10-06 10:12:32,238 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-06 10:12:32,240 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=01f7bd606718ce5b087d4643001d5cbe, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:32,240 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696587152239"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587152239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587152239"}]},"ts":"1696587152239"} 2023-10-06 10:12:32,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 01f7bd606718ce5b087d4643001d5cbe, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:12:32,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. 2023-10-06 10:12:32,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01f7bd606718ce5b087d4643001d5cbe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.', STARTKEY => '', ENDKEY => ''} 2023-10-06 10:12:32,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. service=AccessControlService 2023-10-06 10:12:32,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:12:32,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:32,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:32,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:32,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:32,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/.regioninfo 2023-10-06 10:12:32,510 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 10:12:32,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 10:12:32,845 INFO [StoreOpener-01f7bd606718ce5b087d4643001d5cbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:32,846 DEBUG [StoreOpener-01f7bd606718ce5b087d4643001d5cbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf 2023-10-06 10:12:32,847 DEBUG [StoreOpener-01f7bd606718ce5b087d4643001d5cbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf 2023-10-06 10:12:32,847 INFO [StoreOpener-01f7bd606718ce5b087d4643001d5cbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01f7bd606718ce5b087d4643001d5cbe columnFamilyName cf 2023-10-06 10:12:32,899 DEBUG [StoreOpener-01f7bd606718ce5b087d4643001d5cbe-1] regionserver.HStore(539): loaded hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/1b069e5ae7944774a324511c829ba0e3.e27f94ac5f2613e4c9aaa42251328c76->hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/cf/1b069e5ae7944774a324511c829ba0e3-top 2023-10-06 10:12:32,910 DEBUG [StoreOpener-01f7bd606718ce5b087d4643001d5cbe-1] regionserver.HStore(539): loaded hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/fb87439f73384762b4db46e15d98d4be.bdfeefed792ff48c045b7d3cf7caa700->hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/cf/fb87439f73384762b4db46e15d98d4be-top 2023-10-06 10:12:32,911 INFO [StoreOpener-01f7bd606718ce5b087d4643001d5cbe-1] regionserver.HStore(310): Store=01f7bd606718ce5b087d4643001d5cbe/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:12:32,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:32,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:32,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:32,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 01f7bd606718ce5b087d4643001d5cbe; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66440028, jitterRate=-0.009966433048248291}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:12:32,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 01f7bd606718ce5b087d4643001d5cbe: 2023-10-06 10:12:32,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe., pid=77, masterSystemTime=1696587152394 2023-10-06 10:12:32,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.,because compaction is disabled. 2023-10-06 10:12:32,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. 2023-10-06 10:12:32,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. 2023-10-06 10:12:32,930 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=01f7bd606718ce5b087d4643001d5cbe, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:32,930 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696587152930"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587152930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587152930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587152930"}]},"ts":"1696587152930"} 2023-10-06 10:12:32,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-06 10:12:32,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 01f7bd606718ce5b087d4643001d5cbe, server=jenkins-hbase17.apache.org,36349,1696587032478 in 699 msec 2023-10-06 10:12:32,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-06 10:12:32,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01f7bd606718ce5b087d4643001d5cbe, ASSIGN in 865 msec 2023-10-06 10:12:32,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bdfeefed792ff48c045b7d3cf7caa700, e27f94ac5f2613e4c9aaa42251328c76], force=true in 1.5590 sec 2023-10-06 10:12:33,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 10:12:33,544 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-06 10:12:33,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-06 10:12:33,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587153545 (current time:1696587153545). 2023-10-06 10:12:33,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:12:33,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x6bf253d5 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:33,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@94fac8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:33,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:33,562 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:33,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bf253d5 to 127.0.0.1:65169 2023-10-06 10:12:33,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:33,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x3519b4b6 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:33,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c0c353b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:33,572 DEBUG [hconnection-0x38d3c3f3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:33,577 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:33,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:33,588 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:33,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3519b4b6 to 127.0.0.1:65169 2023-10-06 10:12:33,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:33,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-06 10:12:33,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:12:33,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-06 10:12:33,595 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:12:33,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-06 10:12:33,598 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-06 10:12:33,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-06 10:12:33,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:33,599 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696587753599 2023-10-06 10:12:33,604 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:12:33,604 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:12:33,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-06 10:12:33,606 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-06 10:12:33,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-10-06 10:12:33,608 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-06 10:12:33,609 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696587753609 2023-10-06 10:12:33,704 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:33,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-06 10:12:33,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:33,705 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:12:33,905 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:33,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-06 10:12:33,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:33,907 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:12:34,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,035 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-06 10:12:34,035 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:34,035 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-06 10:12:34,035 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-06 10:12:34,036 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,036 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,037 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:34,037 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:34,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:34,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:34,041 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:34,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,041 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,049 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,049 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-06 10:12:34,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-06 10:12:34,051 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,051 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,051 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,051 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-06 10:12:34,051 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:34,053 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-06 10:12:34,053 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-06 10:12:34,053 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-06 10:12:34,054 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-06 10:12:34,054 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:34,057 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-06 10:12:34,057 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:34,060 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-06 10:12:34,061 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-06 10:12:34,060 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-06 10:12:34,061 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-06 10:12:34,061 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-06 10:12:34,061 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:34,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:34,061 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,061 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-06 10:12:34,062 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,062 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:34,064 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,066 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,066 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:34,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:34,073 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:34,077 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,077 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:34,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-06 10:12:34,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54169378[Count = 0] remaining members to acquire global barrier 2023-10-06 10:12:34,129 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-06 10:12:34,129 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,134 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,134 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,134 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-06 10:12:34,134 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:12:34,134 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:12:34,135 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,135 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-06 10:12:34,135 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-06 10:12:34,135 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:12:34,135 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-06 10:12:34,136 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-06 10:12:34,136 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:12:34,138 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,139 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:12:34,140 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-06 10:12:34,140 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:34,140 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-06 10:12:34,141 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. 2023-10-06 10:12:34,141 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. started... 2023-10-06 10:12:34,147 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 01f7bd606718ce5b087d4643001d5cbe: 2023-10-06 10:12:34,148 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,148 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:12:34,148 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/1b069e5ae7944774a324511c829ba0e3.e27f94ac5f2613e4c9aaa42251328c76->hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/cf/1b069e5ae7944774a324511c829ba0e3-top, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/fb87439f73384762b4db46e15d98d4be.bdfeefed792ff48c045b7d3cf7caa700->hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/cf/fb87439f73384762b4db46e15d98d4be-top] hfiles 2023-10-06 10:12:34,148 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/1b069e5ae7944774a324511c829ba0e3.e27f94ac5f2613e4c9aaa42251328c76 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,153 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/fb87439f73384762b4db46e15d98d4be.bdfeefed792ff48c045b7d3cf7caa700 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,153 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-06 10:12:34,153 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:34,153 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-06 10:12:34,207 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:34,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-06 10:12:34,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:34,222 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-06 10:12:34,238 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. completed. 2023-10-06 10:12:34,238 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. 2023-10-06 10:12:34,239 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:12:34,239 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:12:34,239 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,239 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-06 10:12:34,239 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:12:34,246 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-06 10:12:34,246 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:34,246 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-06 10:12:34,246 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase17.apache.org,36349,1696587032478': 2023-10-06 10:12:34,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-06 10:12:34,253 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-06 10:12:34,253 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:12:34,253 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:12:34,253 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,253 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:12:34,258 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,258 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,258 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:34,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,258 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:34,258 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,259 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:34,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:34,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:34,259 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:34,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:34,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:34,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:34,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:34,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:34,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:34,260 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:34,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,274 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:34,274 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:34,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:34,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:34,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:34,279 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:34,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,279 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:34,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:34,280 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:34,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,284 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:34,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:34,284 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,284 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,284 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:34,284 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:34,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:34,284 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,284 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:34,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:34,285 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:34,285 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:34,285 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,285 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:34,285 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:34,285 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,285 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:34,285 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,286 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:34,286 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:34,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:34,286 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:34,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:34,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:34,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:34,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:34,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:34,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:34,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,458 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-06 10:12:34,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,465 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696587153600Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696587154286 (+686 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696587154289 (+3 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696587154309 (+20 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696587154421 (+112 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696587154458 (+37 ms) 2023-10-06 10:12:34,473 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-06 10:12:34,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 870 msec 2023-10-06 10:12:34,722 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:34,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-06 10:12:34,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:12:34,724 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724 2023-10-06 10:12:34,724 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43027, tgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724, rawTgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724, srcFsUri=hdfs://localhost:43027, srcDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:12:34,759 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:12:34,759 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_79898055_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,759 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae, snapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-06 10:12:34,776 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:34,900 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:34,900 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:34,901 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:34,901 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:36,054 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-7538999424491139731.jar 2023-10-06 10:12:36,055 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:36,055 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:36,143 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-890498251797008886.jar 2023-10-06 10:12:36,143 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:36,144 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:36,144 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:36,145 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:36,145 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:36,146 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:36,146 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 10:12:36,147 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 10:12:36,147 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 10:12:36,148 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 10:12:36,148 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 10:12:36,149 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 10:12:36,150 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 10:12:36,150 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 10:12:36,151 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 10:12:36,151 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 10:12:36,152 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:36,153 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:36,153 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:12:36,154 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:36,154 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:36,155 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:12:36,156 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:12:37,313 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 10:12:39,099 WARN [Listener at jenkins-hbase17.apache.org/42055] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 10:12:39,104 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-06 10:12:39,109 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-06 10:12:39,292 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:12:39,292 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:12:39,391 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0005_000001 (auth:SIMPLE) 2023-10-06 10:12:46,480 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0005_000001 (auth:SIMPLE) 2023-10-06 10:12:48,837 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0005_000001 (auth:SIMPLE) 2023-10-06 10:12:53,947 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0005_000001 (auth:SIMPLE) 2023-10-06 10:12:55,520 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 10:12:55,524 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 10:12:55,554 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,554 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 10:12:55,555 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 10:12:55,555 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,556 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-06 10:12:55,556 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-06 10:12:55,556 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,556 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-06 10:12:55,556 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587154724/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-06 10:12:55,566 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-06 10:12:55,574 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587175574"}]},"ts":"1696587175574"} 2023-10-06 10:12:55,581 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-06 10:12:55,585 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-06 10:12:55,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01f7bd606718ce5b087d4643001d5cbe, UNASSIGN}] 2023-10-06 10:12:55,601 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01f7bd606718ce5b087d4643001d5cbe, UNASSIGN 2023-10-06 10:12:55,604 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=01f7bd606718ce5b087d4643001d5cbe, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:55,605 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696587175604"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587175604"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587175604"}]},"ts":"1696587175604"} 2023-10-06 10:12:55,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 01f7bd606718ce5b087d4643001d5cbe, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:12:55,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-06 10:12:55,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:55,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 01f7bd606718ce5b087d4643001d5cbe, disabling compactions & flushes 2023-10-06 10:12:55,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. 2023-10-06 10:12:55,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. 2023-10-06 10:12:55,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. after waiting 0 ms 2023-10-06 10:12:55,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. 2023-10-06 10:12:55,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-06 10:12:55,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:12:55,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe. 2023-10-06 10:12:55,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 01f7bd606718ce5b087d4643001d5cbe: 2023-10-06 10:12:55,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:55,818 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=01f7bd606718ce5b087d4643001d5cbe, regionState=CLOSED 2023-10-06 10:12:55,819 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696587175818"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587175818"}]},"ts":"1696587175818"} 2023-10-06 10:12:55,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-06 10:12:55,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 01f7bd606718ce5b087d4643001d5cbe, server=jenkins-hbase17.apache.org,36349,1696587032478 in 206 msec 2023-10-06 10:12:55,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-06 10:12:55,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01f7bd606718ce5b087d4643001d5cbe, UNASSIGN in 235 msec 2023-10-06 10:12:55,829 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587175829"}]},"ts":"1696587175829"} 2023-10-06 10:12:55,830 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-06 10:12:55,832 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-06 10:12:55,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 265 msec 2023-10-06 10:12:55,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-06 10:12:55,878 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-06 10:12:55,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,883 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,884 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,885 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,887 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,887 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,887 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,887 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-06 10:12:55,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-06 10:12:55,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-06 10:12:55,887 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,887 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:55,888 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,888 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:55,888 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-06 10:12:55,888 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 10:12:55,888 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:55,888 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:55,888 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:55,889 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:55,889 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:55,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:55,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:55,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:55,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:55,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-06 10:12:55,890 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/recovered.edits] 2023-10-06 10:12:55,890 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/recovered.edits] 2023-10-06 10:12:55,891 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/recovered.edits] 2023-10-06 10:12:55,894 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/cf/1b069e5ae7944774a324511c829ba0e3 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/cf/1b069e5ae7944774a324511c829ba0e3 2023-10-06 10:12:55,895 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/1b069e5ae7944774a324511c829ba0e3.e27f94ac5f2613e4c9aaa42251328c76 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/1b069e5ae7944774a324511c829ba0e3.e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:55,895 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/cf/fb87439f73384762b4db46e15d98d4be to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/cf/fb87439f73384762b4db46e15d98d4be 2023-10-06 10:12:55,898 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/fb87439f73384762b4db46e15d98d4be.bdfeefed792ff48c045b7d3cf7caa700 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/cf/fb87439f73384762b4db46e15d98d4be.bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:55,907 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/recovered.edits/12.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe/recovered.edits/12.seqid 2023-10-06 10:12:55,907 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/recovered.edits/8.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76/recovered.edits/8.seqid 2023-10-06 10:12:55,907 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/recovered.edits/8.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700/recovered.edits/8.seqid 2023-10-06 10:12:55,908 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e27f94ac5f2613e4c9aaa42251328c76 2023-10-06 10:12:55,908 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bdfeefed792ff48c045b7d3cf7caa700 2023-10-06 10:12:55,908 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01f7bd606718ce5b087d4643001d5cbe 2023-10-06 10:12:55,908 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-06 10:12:55,910 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,912 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-06 10:12:55,914 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-06 10:12:55,916 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,916 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-06 10:12:55,916 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587175916"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:55,925 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-06 10:12:55,925 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 01f7bd606718ce5b087d4643001d5cbe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696587150717.01f7bd606718ce5b087d4643001d5cbe.', STARTKEY => '', ENDKEY => ''}] 2023-10-06 10:12:55,925 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-06 10:12:55,925 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696587175925"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:55,933 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-06 10:12:55,935 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:55,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 56 msec 2023-10-06 10:12:55,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-06 10:12:55,991 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-06 10:12:55,992 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:55,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:55,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:55,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-06 10:12:55,998 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587175998"}]},"ts":"1696587175998"} 2023-10-06 10:12:56,000 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-06 10:12:56,002 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-06 10:12:56,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2282a2906c9867767b6c5bacfcf5bead, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=32c583eaca86f440ba360807e17b379c, UNASSIGN}] 2023-10-06 10:12:56,005 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2282a2906c9867767b6c5bacfcf5bead, UNASSIGN 2023-10-06 10:12:56,005 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=32c583eaca86f440ba360807e17b379c, UNASSIGN 2023-10-06 10:12:56,009 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2282a2906c9867767b6c5bacfcf5bead, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:56,009 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=32c583eaca86f440ba360807e17b379c, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:56,010 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587176009"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587176009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587176009"}]},"ts":"1696587176009"} 2023-10-06 10:12:56,010 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587176009"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587176009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587176009"}]},"ts":"1696587176009"} 2023-10-06 10:12:56,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 32c583eaca86f440ba360807e17b379c, server=jenkins-hbase17.apache.org,44159,1696587032316}] 2023-10-06 10:12:56,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 2282a2906c9867767b6c5bacfcf5bead, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:12:56,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-06 10:12:56,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:56,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:56,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2282a2906c9867767b6c5bacfcf5bead, disabling compactions & flushes 2023-10-06 10:12:56,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 32c583eaca86f440ba360807e17b379c, disabling compactions & flushes 2023-10-06 10:12:56,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:56,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:56,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:56,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. after waiting 0 ms 2023-10-06 10:12:56,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:56,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:56,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. after waiting 0 ms 2023-10-06 10:12:56,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:56,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:12:56,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:12:56,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead. 2023-10-06 10:12:56,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2282a2906c9867767b6c5bacfcf5bead: 2023-10-06 10:12:56,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:12:56,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:12:56,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c. 2023-10-06 10:12:56,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 32c583eaca86f440ba360807e17b379c: 2023-10-06 10:12:56,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:56,235 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2282a2906c9867767b6c5bacfcf5bead, regionState=CLOSED 2023-10-06 10:12:56,236 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587176235"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587176235"}]},"ts":"1696587176235"} 2023-10-06 10:12:56,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:56,239 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=32c583eaca86f440ba360807e17b379c, regionState=CLOSED 2023-10-06 10:12:56,239 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696587176239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587176239"}]},"ts":"1696587176239"} 2023-10-06 10:12:56,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-10-06 10:12:56,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 2282a2906c9867767b6c5bacfcf5bead, server=jenkins-hbase17.apache.org,40269,1696587032407 in 227 msec 2023-10-06 10:12:56,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-10-06 10:12:56,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 32c583eaca86f440ba360807e17b379c, server=jenkins-hbase17.apache.org,44159,1696587032316 in 231 msec 2023-10-06 10:12:56,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2282a2906c9867767b6c5bacfcf5bead, UNASSIGN in 240 msec 2023-10-06 10:12:56,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-06 10:12:56,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=32c583eaca86f440ba360807e17b379c, UNASSIGN in 243 msec 2023-10-06 10:12:56,256 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587176256"}]},"ts":"1696587176256"} 2023-10-06 10:12:56,259 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-06 10:12:56,261 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-06 10:12:56,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 269 msec 2023-10-06 10:12:56,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-06 10:12:56,302 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-06 10:12:56,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,306 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,308 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,309 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,311 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,311 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,311 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,311 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 10:12:56,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 10:12:56,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 10:12:56,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 10:12:56,313 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:56,313 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:56,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:56,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:56,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:56,314 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:56,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-06 10:12:56,316 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/recovered.edits] 2023-10-06 10:12:56,316 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/recovered.edits] 2023-10-06 10:12:56,321 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/cf/5b6c3f62672a49cebcba24ebcff9be72 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/cf/5b6c3f62672a49cebcba24ebcff9be72 2023-10-06 10:12:56,321 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/cf/7d4ae2c547fa42c5b4746b4b4727b436 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/cf/7d4ae2c547fa42c5b4746b4b4727b436 2023-10-06 10:12:56,331 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c/recovered.edits/9.seqid 2023-10-06 10:12:56,331 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/32c583eaca86f440ba360807e17b379c 2023-10-06 10:12:56,332 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead/recovered.edits/9.seqid 2023-10-06 10:12:56,333 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2282a2906c9867767b6c5bacfcf5bead 2023-10-06 10:12:56,333 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-06 10:12:56,334 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-06 10:12:56,334 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-06 10:12:56,338 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310066d22fa237d864defa71bcde77d32a134 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310066d22fa237d864defa71bcde77d32a134 2023-10-06 10:12:56,339 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310061b981c1b4d86490a9f9a3c4540076d59 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310061b981c1b4d86490a9f9a3c4540076d59 2023-10-06 10:12:56,339 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-06 10:12:56,341 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,345 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-06 10:12:56,354 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-06 10:12:56,357 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,357 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-06 10:12:56,358 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587176358"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:56,358 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587176358"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:56,360 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 10:12:56,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2282a2906c9867767b6c5bacfcf5bead, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696587147579.2282a2906c9867767b6c5bacfcf5bead.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 32c583eaca86f440ba360807e17b379c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696587147579.32c583eaca86f440ba360807e17b379c.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 10:12:56,361 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-06 10:12:56,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696587176361"}]},"ts":"9223372036854775807"} 2023-10-06 10:12:56,364 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-06 10:12:56,369 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 66 msec 2023-10-06 10:12:56,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-06 10:12:56,417 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-06 10:12:56,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-06 10:12:56,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-06 10:12:56,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 10:12:56,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-06 10:12:56,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 10:12:56,471 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 743) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1956533468) connection to jenkins-hbase17.apache.org/136.243.18.41:45933 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1186752765_1 at /127.0.0.1:52798 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4208 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1956533468) connection to jenkins-hbase17.apache.org/136.243.18.41:37615 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:44718 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1186752765_1 at /127.0.0.1:44430 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:52814 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1956533468) connection to jenkins-hbase17.apache.org/136.243.18.41:42055 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:44462 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1003 (was 848) - SystemLoadAverage LEAK? -, ProcessCount=195 (was 195), AvailableMemoryMB=741 (was 848) 2023-10-06 10:12:56,472 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-10-06 10:12:56,498 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=1003, ProcessCount=192, AvailableMemoryMB=735 2023-10-06 10:12:56,498 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-10-06 10:12:56,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 10:12:56,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 10:12:56,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 10:12:56,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-06 10:12:56,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 10:12:56,508 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 10:12:56,511 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:12:56,511 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:12:56,511 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b empty. 2023-10-06 10:12:56,511 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c empty. 2023-10-06 10:12:56,512 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:12:56,512 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:12:56,512 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-06 10:12:56,556 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-06 10:12:56,558 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => dd71cbe045baebca064b1f982aa9ff4b, NAME => 'testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:12:56,561 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4bced11d463264fcb7323361f39a6c2c, NAME => 'testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:12:56,598 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:56,598 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing dd71cbe045baebca064b1f982aa9ff4b, disabling compactions & flushes 2023-10-06 10:12:56,598 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:56,598 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:56,598 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. after waiting 0 ms 2023-10-06 10:12:56,598 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:56,598 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:56,598 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for dd71cbe045baebca064b1f982aa9ff4b: 2023-10-06 10:12:56,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 10:12:56,612 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:56,612 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4bced11d463264fcb7323361f39a6c2c, disabling compactions & flushes 2023-10-06 10:12:56,612 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:56,612 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:56,612 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. after waiting 0 ms 2023-10-06 10:12:56,612 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:56,612 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:56,612 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4bced11d463264fcb7323361f39a6c2c: 2023-10-06 10:12:56,614 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 10:12:56,615 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587176615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587176615"}]},"ts":"1696587176615"} 2023-10-06 10:12:56,615 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587176615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587176615"}]},"ts":"1696587176615"} 2023-10-06 10:12:56,617 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 10:12:56,618 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 10:12:56,619 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587176619"}]},"ts":"1696587176619"} 2023-10-06 10:12:56,620 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-06 10:12:56,622 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:12:56,623 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:12:56,623 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:12:56,623 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:12:56,624 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:12:56,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dd71cbe045baebca064b1f982aa9ff4b, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bced11d463264fcb7323361f39a6c2c, ASSIGN}] 2023-10-06 10:12:56,626 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bced11d463264fcb7323361f39a6c2c, ASSIGN 2023-10-06 10:12:56,626 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dd71cbe045baebca064b1f982aa9ff4b, ASSIGN 2023-10-06 10:12:56,629 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bced11d463264fcb7323361f39a6c2c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40269,1696587032407; forceNewPlan=false, retain=false 2023-10-06 10:12:56,629 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dd71cbe045baebca064b1f982aa9ff4b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36349,1696587032478; forceNewPlan=false, retain=false 2023-10-06 10:12:56,779 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 10:12:56,783 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4bced11d463264fcb7323361f39a6c2c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:56,783 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587176783"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587176783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587176783"}]},"ts":"1696587176783"} 2023-10-06 10:12:56,784 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=dd71cbe045baebca064b1f982aa9ff4b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:56,784 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587176783"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587176783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587176783"}]},"ts":"1696587176783"} 2023-10-06 10:12:56,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 4bced11d463264fcb7323361f39a6c2c, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:12:56,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure dd71cbe045baebca064b1f982aa9ff4b, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:12:56,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 10:12:56,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:56,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:56,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4bced11d463264fcb7323361f39a6c2c, NAME => 'testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 10:12:56,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd71cbe045baebca064b1f982aa9ff4b, NAME => 'testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 10:12:56,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. service=AccessControlService 2023-10-06 10:12:56,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:12:56,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:12:56,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:56,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:12:56,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:12:56,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. service=AccessControlService 2023-10-06 10:12:56,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:12:56,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:12:56,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:12:56,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:12:56,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:12:56,947 INFO [StoreOpener-dd71cbe045baebca064b1f982aa9ff4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:12:56,947 INFO [StoreOpener-4bced11d463264fcb7323361f39a6c2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:12:56,949 DEBUG [StoreOpener-4bced11d463264fcb7323361f39a6c2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/cf 2023-10-06 10:12:56,949 DEBUG [StoreOpener-dd71cbe045baebca064b1f982aa9ff4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/cf 2023-10-06 10:12:56,949 DEBUG [StoreOpener-dd71cbe045baebca064b1f982aa9ff4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/cf 2023-10-06 10:12:56,949 DEBUG [StoreOpener-4bced11d463264fcb7323361f39a6c2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/cf 2023-10-06 10:12:56,949 INFO [StoreOpener-4bced11d463264fcb7323361f39a6c2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4bced11d463264fcb7323361f39a6c2c columnFamilyName cf 2023-10-06 10:12:56,949 INFO [StoreOpener-dd71cbe045baebca064b1f982aa9ff4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd71cbe045baebca064b1f982aa9ff4b columnFamilyName cf 2023-10-06 10:12:56,951 INFO [StoreOpener-dd71cbe045baebca064b1f982aa9ff4b-1] regionserver.HStore(310): Store=dd71cbe045baebca064b1f982aa9ff4b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:12:56,951 INFO [StoreOpener-4bced11d463264fcb7323361f39a6c2c-1] regionserver.HStore(310): Store=4bced11d463264fcb7323361f39a6c2c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:12:56,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:12:56,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:12:56,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:12:56,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:12:56,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:12:56,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:12:56,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:12:56,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4bced11d463264fcb7323361f39a6c2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63083385, jitterRate=-0.05998431146144867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:12:56,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4bced11d463264fcb7323361f39a6c2c: 2023-10-06 10:12:56,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c., pid=93, masterSystemTime=1696587176941 2023-10-06 10:12:56,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:56,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:56,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:12:56,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened dd71cbe045baebca064b1f982aa9ff4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71992854, jitterRate=0.07277712225914001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:12:56,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for dd71cbe045baebca064b1f982aa9ff4b: 2023-10-06 10:12:56,965 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4bced11d463264fcb7323361f39a6c2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:56,965 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587176965"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587176965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587176965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587176965"}]},"ts":"1696587176965"} 2023-10-06 10:12:56,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b., pid=94, masterSystemTime=1696587176941 2023-10-06 10:12:56,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-06 10:12:56,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 4bced11d463264fcb7323361f39a6c2c, server=jenkins-hbase17.apache.org,40269,1696587032407 in 181 msec 2023-10-06 10:12:56,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:56,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:56,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bced11d463264fcb7323361f39a6c2c, ASSIGN in 347 msec 2023-10-06 10:12:56,978 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=dd71cbe045baebca064b1f982aa9ff4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:56,978 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587176978"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587176978"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587176978"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587176978"}]},"ts":"1696587176978"} 2023-10-06 10:12:56,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-06 10:12:56,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure dd71cbe045baebca064b1f982aa9ff4b, server=jenkins-hbase17.apache.org,36349,1696587032478 in 193 msec 2023-10-06 10:12:56,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-06 10:12:56,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dd71cbe045baebca064b1f982aa9ff4b, ASSIGN in 363 msec 2023-10-06 10:12:56,997 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 10:12:56,997 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587176997"}]},"ts":"1696587176997"} 2023-10-06 10:12:57,009 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-06 10:12:57,015 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 10:12:57,016 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-06 10:12:57,026 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 10:12:57,027 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:57,027 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:57,027 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:57,027 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:12:57,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:57,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:57,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:57,034 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 10:12:57,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 534 msec 2023-10-06 10:12:57,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 10:12:57,113 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-06 10:12:57,117 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-06 10:12:57,117 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:57,118 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:12:57,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:12:57,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587177143 (current time:1696587177143). 2023-10-06 10:12:57,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:12:57,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x1f8dcfd9 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:57,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@875a128, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:57,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:57,191 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:57,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f8dcfd9 to 127.0.0.1:65169 2023-10-06 10:12:57,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:57,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x6062f7e6 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:57,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11600f34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:57,206 DEBUG [hconnection-0x34b980d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:57,208 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:57,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:57,219 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:57,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6062f7e6 to 127.0.0.1:65169 2023-10-06 10:12:57,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:57,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 10:12:57,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:12:57,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:12:57,235 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:12:57,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:12:57,244 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:12:57,245 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696587777245 2023-10-06 10:12:57,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:12:57,245 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-06 10:12:57,249 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:12:57,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 10:12:57,250 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:12:57,250 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:12:57,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-10-06 10:12:57,256 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 10:12:57,257 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696587777257 2023-10-06 10:12:57,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,316 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-06 10:12:57,316 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:57,322 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-06 10:12:57,322 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-06 10:12:57,323 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,323 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,327 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,327 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,327 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,327 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,328 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,328 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,330 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,330 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:12:57,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-06 10:12:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-06 10:12:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 10:12:57,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 10:12:57,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-06 10:12:57,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,336 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 10:12:57,337 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,337 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 10:12:57,337 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:57,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,352 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 10:12:57,352 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 10:12:57,352 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 10:12:57,353 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:57,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,358 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 10:12:57,358 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:57,360 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 10:12:57,360 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 10:12:57,360 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 10:12:57,360 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 10:12:57,360 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:57,362 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 10:12:57,363 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 10:12:57,363 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 10:12:57,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:12:57,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:57,366 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:12:57,366 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,373 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,373 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,373 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:57,373 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,374 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,374 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,374 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,374 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:57,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,377 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 10:12:57,377 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:57,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d921d9[Count = 1] remaining members to acquire global barrier 2023-10-06 10:12:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 10:12:57,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d921d9[Count = 0] remaining members to acquire global barrier 2023-10-06 10:12:57,380 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 10:12:57,380 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,381 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,381 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,381 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,381 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:12:57,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,382 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:12:57,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,382 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,382 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 10:12:57,382 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:12:57,382 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:12:57,382 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,382 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:12:57,383 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 10:12:57,383 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:57,383 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 10:12:57,383 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:12:57,383 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:12:57,383 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:57,383 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. started... 2023-10-06 10:12:57,383 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd71cbe045baebca064b1f982aa9ff4b: 2023-10-06 10:12:57,389 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:12:57,389 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:57,389 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:12:57,389 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. started... 2023-10-06 10:12:57,389 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,389 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:12:57,389 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:12:57,390 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4bced11d463264fcb7323361f39a6c2c: 2023-10-06 10:12:57,391 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,391 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:12:57,391 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:12:57,417 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. completed. 2023-10-06 10:12:57,417 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:57,417 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:12:57,417 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:12:57,417 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,417 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 10:12:57,417 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:12:57,418 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,418 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 10:12:57,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,418 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:57,419 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 10:12:57,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,420 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. completed. 2023-10-06 10:12:57,420 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:57,420 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:12:57,420 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:12:57,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,420 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,420 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 10:12:57,420 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:12:57,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,421 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 10:12:57,421 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:57,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,421 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,421 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 10:12:57,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,36349,1696587032478': 2023-10-06 10:12:57,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 10:12:57,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:12:57,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 10:12:57,427 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-06 10:12:57,427 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:12:57,427 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:12:57,427 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,427 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:12:57,428 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,428 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,428 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,429 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,429 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,431 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,431 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,431 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,434 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-06 10:12:57,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,435 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:57,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,435 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:12:57,436 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,436 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,436 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,436 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,436 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 10:12:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-06 10:12:57,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,466 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696587177245Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696587177444 (+199 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696587177444Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696587177445 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696587177448 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696587177456 (+8 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696587177465 (+9 ms) 2023-10-06 10:12:57,469 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 10:12:57,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 223 msec 2023-10-06 10:12:57,566 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:57,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:12:57,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:12:57,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:12:57,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40269] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:12:57,583 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-06 10:12:57,584 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:57,584 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:12:57,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:12:57,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587177610 (current time:1696587177610). 2023-10-06 10:12:57,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:12:57,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x375315f9 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:57,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ce99347, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:57,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:57,639 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:57,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x375315f9 to 127.0.0.1:65169 2023-10-06 10:12:57,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:57,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x591611b3 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:12:57,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76c52bb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:12:57,673 DEBUG [hconnection-0x26e6ed81-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:57,676 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:57,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:12:57,687 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:12:57,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x591611b3 to 127.0.0.1:65169 2023-10-06 10:12:57,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:12:57,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 10:12:57,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:12:57,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:12:57,703 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:12:57,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:12:57,718 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:12:57,720 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696587777720 2023-10-06 10:12:57,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-06 10:12:57,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 10:12:57,723 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:12:57,723 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:12:57,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 10:12:57,726 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 10:12:57,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 22 msec 2023-10-06 10:12:57,729 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 10:12:57,730 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696587777730 2023-10-06 10:12:57,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,762 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-06 10:12:57,762 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:57,764 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-06 10:12:57,764 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-06 10:12:57,764 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,764 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,768 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,768 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,768 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,768 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,768 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,768 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,769 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,769 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:12:57,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-06 10:12:57,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,772 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 10:12:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-06 10:12:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,773 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 10:12:57,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-06 10:12:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,773 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 10:12:57,773 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:57,773 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 10:12:57,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,778 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 10:12:57,778 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 10:12:57,778 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:57,778 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 10:12:57,779 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 10:12:57,778 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 10:12:57,779 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:12:57,779 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 10:12:57,779 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 10:12:57,783 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 10:12:57,783 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 10:12:57,784 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 10:12:57,784 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 10:12:57,785 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,785 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,785 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,786 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,786 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,786 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,786 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,786 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:57,786 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:57,787 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,787 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:12:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 10:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e72b808[Count = 1] remaining members to acquire global barrier 2023-10-06 10:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 10:12:57,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e72b808[Count = 0] remaining members to acquire global barrier 2023-10-06 10:12:57,790 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 10:12:57,790 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:12:57,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,791 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 10:12:57,791 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,791 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:12:57,791 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:12:57,791 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 10:12:57,791 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:12:57,791 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:12:57,791 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,791 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:12:57,791 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:57,791 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. started... 2023-10-06 10:12:57,792 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4bced11d463264fcb7323361f39a6c2c 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-06 10:12:57,792 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 10:12:57,792 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:57,792 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 10:12:57,793 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:12:57,794 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:12:57,794 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:57,794 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. started... 2023-10-06 10:12:57,795 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dd71cbe045baebca064b1f982aa9ff4b 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-06 10:12:57,825 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310068f9f3f5a0c104d19a8b1a24a5e141d93 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310068f9f3f5a0c104d19a8b1a24a5e141d93 2023-10-06 10:12:57,825 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:57,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:12:57,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:12:57,826 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:12:57,831 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231006cd4b5bc2f9554806a0c843c3cfce887c to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006cd4b5bc2f9554806a0c843c3cfce887c 2023-10-06 10:12:57,853 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/.tmp/cf/e20865a88fba48509ec31084148e79ee 2023-10-06 10:12:57,856 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/.tmp/cf/6ed624e50f8541fba506a92113c010c5 2023-10-06 10:12:57,859 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/.tmp/cf/e20865a88fba48509ec31084148e79ee as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/cf/e20865a88fba48509ec31084148e79ee 2023-10-06 10:12:57,864 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/.tmp/cf/6ed624e50f8541fba506a92113c010c5 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/cf/6ed624e50f8541fba506a92113c010c5 2023-10-06 10:12:57,870 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/cf/e20865a88fba48509ec31084148e79ee, entries=4, sequenceid=6, filesize=5.6 K 2023-10-06 10:12:57,871 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for dd71cbe045baebca064b1f982aa9ff4b in 76ms, sequenceid=6, compaction requested=false 2023-10-06 10:12:57,871 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-06 10:12:57,872 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd71cbe045baebca064b1f982aa9ff4b: 2023-10-06 10:12:57,872 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,874 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:12:57,874 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/cf/e20865a88fba48509ec31084148e79ee] hfiles 2023-10-06 10:12:57,874 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/cf/e20865a88fba48509ec31084148e79ee for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,876 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/cf/6ed624e50f8541fba506a92113c010c5, entries=46, sequenceid=6, filesize=12.9 K 2023-10-06 10:12:57,877 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 4bced11d463264fcb7323361f39a6c2c in 86ms, sequenceid=6, compaction requested=false 2023-10-06 10:12:57,879 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4bced11d463264fcb7323361f39a6c2c: 2023-10-06 10:12:57,880 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,880 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:12:57,880 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/cf/6ed624e50f8541fba506a92113c010c5] hfiles 2023-10-06 10:12:57,880 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/cf/6ed624e50f8541fba506a92113c010c5 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,894 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. completed. 2023-10-06 10:12:57,894 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:12:57,894 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:12:57,894 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:12:57,894 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,894 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 10:12:57,894 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:12:57,896 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 10:12:57,896 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:57,896 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 10:12:57,899 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,36349,1696587032478': 2023-10-06 10:12:57,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 10:12:57,909 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. completed. 2023-10-06 10:12:57,909 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:12:57,910 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:12:57,910 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:12:57,910 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,910 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 10:12:57,910 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:12:57,911 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 10:12:57,911 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:57,911 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,911 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 10:12:57,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:12:57,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 10:12:57,916 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-06 10:12:57,916 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:12:57,916 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:12:57,916 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,916 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:12:57,918 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,918 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,918 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:12:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:12:57,918 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,919 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,918 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,918 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,919 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:12:57,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,920 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:12:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,921 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:12:57,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,923 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,923 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,923 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,931 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:12:57,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,931 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:12:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,933 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:12:57,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:12:57,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-06 10:12:57,933 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:12:57,933 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,934 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:12:57,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:12:57,934 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:12:57,934 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,934 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006cd4b5bc2f9554806a0c843c3cfce887c, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310068f9f3f5a0c104d19a8b1a24a5e141d93] mob files 2023-10-06 10:12:57,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006cd4b5bc2f9554806a0c843c3cfce887c 2023-10-06 10:12:57,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310068f9f3f5a0c104d19a8b1a24a5e141d93 2023-10-06 10:12:57,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:12:57,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:12:57,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:57,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:58,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:58,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-06 10:12:58,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:58,011 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:58,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696587177720Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696587177950 (+230 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696587177950Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696587177950Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696587177954 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696587177992 (+38 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696587178010 (+18 ms) 2023-10-06 10:12:58,015 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 10:12:58,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 293 msec 2023-10-06 10:12:58,026 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:12:58,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 10:12:58,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:12:58,030 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030 2023-10-06 10:12:58,031 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43027, tgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030, rawTgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030, srcFsUri=hdfs://localhost:43027, srcDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:12:58,061 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:12:58,061 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1993120914_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:58,062 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae, snapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-06 10:12:58,076 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:12:58,157 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:58,157 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:58,158 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:58,158 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:59,194 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-6359292615322708146.jar 2023-10-06 10:12:59,195 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:59,195 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:59,276 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-291687203767573647.jar 2023-10-06 10:12:59,277 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:59,277 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:59,278 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:59,278 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:59,278 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:59,279 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 10:12:59,279 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 10:12:59,280 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 10:12:59,280 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 10:12:59,281 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 10:12:59,281 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 10:12:59,282 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 10:12:59,283 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 10:12:59,283 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 10:12:59,284 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 10:12:59,284 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 10:12:59,285 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:59,285 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:59,286 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:12:59,286 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:59,286 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:12:59,287 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:12:59,287 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:13:00,253 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0005_000001 (auth:SIMPLE) 2023-10-06 10:13:01,398 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 10:13:02,672 WARN [Listener at jenkins-hbase17.apache.org/42055] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 10:13:02,677 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-06 10:13:03,199 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:13:03,200 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:13:03,263 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0006_000001 (auth:SIMPLE) 2023-10-06 10:13:08,792 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0006_000001 (auth:SIMPLE) 2023-10-06 10:13:11,541 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 10:13:11,544 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 10:13:11,593 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:13:11,593 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 10:13:11,594 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 10:13:11,594 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:13:11,595 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-06 10:13:11,595 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-06 10:13:11,595 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:13:11,595 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-06 10:13:11,596 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587178030/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-06 10:13:11,604 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-06 10:13:11,623 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587191623"}]},"ts":"1696587191623"} 2023-10-06 10:13:11,625 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-06 10:13:11,626 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-06 10:13:11,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dd71cbe045baebca064b1f982aa9ff4b, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bced11d463264fcb7323361f39a6c2c, UNASSIGN}] 2023-10-06 10:13:11,627 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bced11d463264fcb7323361f39a6c2c, UNASSIGN 2023-10-06 10:13:11,633 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dd71cbe045baebca064b1f982aa9ff4b, UNASSIGN 2023-10-06 10:13:11,634 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4bced11d463264fcb7323361f39a6c2c, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:11,634 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=dd71cbe045baebca064b1f982aa9ff4b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:11,634 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587191634"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587191634"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587191634"}]},"ts":"1696587191634"} 2023-10-06 10:13:11,634 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587191634"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587191634"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587191634"}]},"ts":"1696587191634"} 2023-10-06 10:13:11,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure dd71cbe045baebca064b1f982aa9ff4b, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:13:11,640 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 4bced11d463264fcb7323361f39a6c2c, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:13:11,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-06 10:13:11,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:13:11,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing dd71cbe045baebca064b1f982aa9ff4b, disabling compactions & flushes 2023-10-06 10:13:11,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:13:11,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:13:11,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. after waiting 0 ms 2023-10-06 10:13:11,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:13:11,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:13:11,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4bced11d463264fcb7323361f39a6c2c, disabling compactions & flushes 2023-10-06 10:13:11,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:13:11,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:13:11,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. after waiting 0 ms 2023-10-06 10:13:11,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:13:11,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:13:11,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:13:11,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:13:11,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:13:11,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b. 2023-10-06 10:13:11,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c. 2023-10-06 10:13:11,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for dd71cbe045baebca064b1f982aa9ff4b: 2023-10-06 10:13:11,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4bced11d463264fcb7323361f39a6c2c: 2023-10-06 10:13:11,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:13:11,837 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=dd71cbe045baebca064b1f982aa9ff4b, regionState=CLOSED 2023-10-06 10:13:11,837 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587191837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587191837"}]},"ts":"1696587191837"} 2023-10-06 10:13:11,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:13:11,838 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4bced11d463264fcb7323361f39a6c2c, regionState=CLOSED 2023-10-06 10:13:11,838 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696587191838"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587191838"}]},"ts":"1696587191838"} 2023-10-06 10:13:11,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-06 10:13:11,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure dd71cbe045baebca064b1f982aa9ff4b, server=jenkins-hbase17.apache.org,36349,1696587032478 in 202 msec 2023-10-06 10:13:11,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-06 10:13:11,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 4bced11d463264fcb7323361f39a6c2c, server=jenkins-hbase17.apache.org,40269,1696587032407 in 204 msec 2023-10-06 10:13:11,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dd71cbe045baebca064b1f982aa9ff4b, UNASSIGN in 215 msec 2023-10-06 10:13:11,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-06 10:13:11,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bced11d463264fcb7323361f39a6c2c, UNASSIGN in 217 msec 2023-10-06 10:13:11,848 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587191848"}]},"ts":"1696587191848"} 2023-10-06 10:13:11,850 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-06 10:13:11,852 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-06 10:13:11,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 252 msec 2023-10-06 10:13:11,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-06 10:13:11,918 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-06 10:13:11,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,930 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,932 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,933 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,936 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,936 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,936 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,936 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 10:13:11,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 10:13:11,939 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 10:13:11,941 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,941 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:11,942 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,942 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:11,944 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:13:11,944 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:13:11,945 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 10:13:11,945 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:11,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-06 10:13:11,948 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/recovered.edits] 2023-10-06 10:13:11,948 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/recovered.edits] 2023-10-06 10:13:11,949 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,949 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:11,959 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/cf/6ed624e50f8541fba506a92113c010c5 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/cf/6ed624e50f8541fba506a92113c010c5 2023-10-06 10:13:11,959 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/cf/e20865a88fba48509ec31084148e79ee to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/cf/e20865a88fba48509ec31084148e79ee 2023-10-06 10:13:11,962 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b/recovered.edits/9.seqid 2023-10-06 10:13:11,962 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c/recovered.edits/9.seqid 2023-10-06 10:13:11,963 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/dd71cbe045baebca064b1f982aa9ff4b 2023-10-06 10:13:11,963 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bced11d463264fcb7323361f39a6c2c 2023-10-06 10:13:11,963 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-06 10:13:11,963 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-06 10:13:11,964 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-06 10:13:11,969 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006cd4b5bc2f9554806a0c843c3cfce887c to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006cd4b5bc2f9554806a0c843c3cfce887c 2023-10-06 10:13:11,971 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310068f9f3f5a0c104d19a8b1a24a5e141d93 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310068f9f3f5a0c104d19a8b1a24a5e141d93 2023-10-06 10:13:11,972 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-06 10:13:11,978 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 10:13:11,982 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-06 10:13:11,993 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-06 10:13:12,001 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 10:13:12,001 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-06 10:13:12,001 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587192001"}]},"ts":"9223372036854775807"} 2023-10-06 10:13:12,001 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587192001"}]},"ts":"9223372036854775807"} 2023-10-06 10:13:12,007 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 10:13:12,007 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dd71cbe045baebca064b1f982aa9ff4b, NAME => 'testtb-testEmptyExportFileSystemState,,1696587176500.dd71cbe045baebca064b1f982aa9ff4b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4bced11d463264fcb7323361f39a6c2c, NAME => 'testtb-testEmptyExportFileSystemState,1,1696587176500.4bced11d463264fcb7323361f39a6c2c.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 10:13:12,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-06 10:13:12,007 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696587192007"}]},"ts":"9223372036854775807"} 2023-10-06 10:13:12,015 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-06 10:13:12,016 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 10:13:12,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 95 msec 2023-10-06 10:13:12,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-06 10:13:12,048 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-06 10:13:12,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-06 10:13:12,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 10:13:12,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-06 10:13:12,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-06 10:13:12,105 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 760) Potentially hanging thread: IPC Client (1956533468) connection to jenkins-hbase17.apache.org/136.243.18.41:38287 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_817078307_1 at /127.0.0.1:57004 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:57018 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-600076826_17 at /127.0.0.1:51704 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1956533468) connection to jenkins-hbase17.apache.org/136.243.18.41:39587 from appattempt_1696587045125_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4ec58b09-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-196855247_17 at /127.0.0.1:46546 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4980 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 905), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1007 (was 1003) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 192), AvailableMemoryMB=3393 (was 735) - AvailableMemoryMB LEAK? - 2023-10-06 10:13:12,106 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-06 10:13:12,134 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=1007, ProcessCount=192, AvailableMemoryMB=3385 2023-10-06 10:13:12,134 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-06 10:13:12,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 10:13:12,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:12,142 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 10:13:12,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-06 10:13:12,143 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 10:13:12,147 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:12,147 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:12,148 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c empty. 2023-10-06 10:13:12,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 10:13:12,148 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77 empty. 2023-10-06 10:13:12,153 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:12,154 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:12,155 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-06 10:13:12,249 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-06 10:13:12,252 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d5a2c23360941e2243df0f2a41b562c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:13:12,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 10:13:12,257 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9dd88f4c1b807ccea93292791255cc77, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp 2023-10-06 10:13:12,395 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:13:12,395 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 9dd88f4c1b807ccea93292791255cc77, disabling compactions & flushes 2023-10-06 10:13:12,395 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:12,395 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:12,395 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. after waiting 0 ms 2023-10-06 10:13:12,395 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:12,395 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:12,395 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 9dd88f4c1b807ccea93292791255cc77: 2023-10-06 10:13:12,421 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:13:12,421 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 4d5a2c23360941e2243df0f2a41b562c, disabling compactions & flushes 2023-10-06 10:13:12,421 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:12,422 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:12,422 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. after waiting 0 ms 2023-10-06 10:13:12,422 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:12,422 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:12,422 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 4d5a2c23360941e2243df0f2a41b562c: 2023-10-06 10:13:12,431 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 10:13:12,432 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587192432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587192432"}]},"ts":"1696587192432"} 2023-10-06 10:13:12,432 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587192432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587192432"}]},"ts":"1696587192432"} 2023-10-06 10:13:12,436 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 10:13:12,437 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 10:13:12,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587192437"}]},"ts":"1696587192437"} 2023-10-06 10:13:12,438 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-06 10:13:12,441 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-06 10:13:12,442 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 10:13:12,442 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 10:13:12,442 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 10:13:12,442 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 10:13:12,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d5a2c23360941e2243df0f2a41b562c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9dd88f4c1b807ccea93292791255cc77, ASSIGN}] 2023-10-06 10:13:12,447 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9dd88f4c1b807ccea93292791255cc77, ASSIGN 2023-10-06 10:13:12,447 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d5a2c23360941e2243df0f2a41b562c, ASSIGN 2023-10-06 10:13:12,448 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9dd88f4c1b807ccea93292791255cc77, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36349,1696587032478; forceNewPlan=false, retain=false 2023-10-06 10:13:12,448 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d5a2c23360941e2243df0f2a41b562c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40269,1696587032407; forceNewPlan=false, retain=false 2023-10-06 10:13:12,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 10:13:12,598 INFO [jenkins-hbase17:45845] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 10:13:12,602 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4d5a2c23360941e2243df0f2a41b562c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:12,602 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9dd88f4c1b807ccea93292791255cc77, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:12,602 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587192602"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587192602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587192602"}]},"ts":"1696587192602"} 2023-10-06 10:13:12,602 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587192602"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587192602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587192602"}]},"ts":"1696587192602"} 2023-10-06 10:13:12,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 4d5a2c23360941e2243df0f2a41b562c, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:13:12,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 9dd88f4c1b807ccea93292791255cc77, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:13:12,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 10:13:12,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:12,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d5a2c23360941e2243df0f2a41b562c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 10:13:12,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. service=AccessControlService 2023-10-06 10:13:12,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:13:12,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:12,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:13:12,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:12,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:12,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:12,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9dd88f4c1b807ccea93292791255cc77, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 10:13:12,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. service=AccessControlService 2023-10-06 10:13:12,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 10:13:12,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:12,771 INFO [StoreOpener-4d5a2c23360941e2243df0f2a41b562c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:12,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 10:13:12,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:12,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:12,773 DEBUG [StoreOpener-4d5a2c23360941e2243df0f2a41b562c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/cf 2023-10-06 10:13:12,773 DEBUG [StoreOpener-4d5a2c23360941e2243df0f2a41b562c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/cf 2023-10-06 10:13:12,773 INFO [StoreOpener-4d5a2c23360941e2243df0f2a41b562c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d5a2c23360941e2243df0f2a41b562c columnFamilyName cf 2023-10-06 10:13:12,773 INFO [StoreOpener-9dd88f4c1b807ccea93292791255cc77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:12,782 INFO [StoreOpener-4d5a2c23360941e2243df0f2a41b562c-1] regionserver.HStore(310): Store=4d5a2c23360941e2243df0f2a41b562c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:13:12,782 DEBUG [StoreOpener-9dd88f4c1b807ccea93292791255cc77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/cf 2023-10-06 10:13:12,783 DEBUG [StoreOpener-9dd88f4c1b807ccea93292791255cc77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/cf 2023-10-06 10:13:12,783 INFO [StoreOpener-9dd88f4c1b807ccea93292791255cc77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dd88f4c1b807ccea93292791255cc77 columnFamilyName cf 2023-10-06 10:13:12,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:12,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:12,784 INFO [StoreOpener-9dd88f4c1b807ccea93292791255cc77-1] regionserver.HStore(310): Store=9dd88f4c1b807ccea93292791255cc77/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 10:13:12,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:12,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:12,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:12,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:12,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:13:12,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 9dd88f4c1b807ccea93292791255cc77; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72694372, jitterRate=0.08323055505752563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:13:12,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 9dd88f4c1b807ccea93292791255cc77: 2023-10-06 10:13:12,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77., pid=109, masterSystemTime=1696587192766 2023-10-06 10:13:12,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:12,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:12,808 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9dd88f4c1b807ccea93292791255cc77, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:12,809 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587192808"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587192808"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587192808"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587192808"}]},"ts":"1696587192808"} 2023-10-06 10:13:12,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 10:13:12,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4d5a2c23360941e2243df0f2a41b562c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71975915, jitterRate=0.07252471148967743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 10:13:12,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4d5a2c23360941e2243df0f2a41b562c: 2023-10-06 10:13:12,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-06 10:13:12,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 9dd88f4c1b807ccea93292791255cc77, server=jenkins-hbase17.apache.org,36349,1696587032478 in 199 msec 2023-10-06 10:13:12,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c., pid=108, masterSystemTime=1696587192764 2023-10-06 10:13:12,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9dd88f4c1b807ccea93292791255cc77, ASSIGN in 370 msec 2023-10-06 10:13:12,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:12,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:12,819 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4d5a2c23360941e2243df0f2a41b562c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:12,819 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587192819"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696587192819"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696587192819"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696587192819"}]},"ts":"1696587192819"} 2023-10-06 10:13:12,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-06 10:13:12,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 4d5a2c23360941e2243df0f2a41b562c, server=jenkins-hbase17.apache.org,40269,1696587032407 in 214 msec 2023-10-06 10:13:12,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-06 10:13:12,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d5a2c23360941e2243df0f2a41b562c, ASSIGN in 385 msec 2023-10-06 10:13:12,841 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 10:13:12,842 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587192841"}]},"ts":"1696587192841"} 2023-10-06 10:13:12,849 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-06 10:13:12,864 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 10:13:12,864 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-06 10:13:12,867 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-06 10:13:12,870 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:12,870 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:12,870 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:12,870 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:12,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 10:13:12,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 10:13:12,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 10:13:12,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 10:13:12,883 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 739 msec 2023-10-06 10:13:13,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 10:13:13,257 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-06 10:13:13,278 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,278 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:13,280 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:13:13,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 10:13:13,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587193345 (current time:1696587193345). 2023-10-06 10:13:13,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:13:13,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x1b950ace to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:13:13,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79674834, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:13:13,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:13:13,400 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:13:13,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b950ace to 127.0.0.1:65169 2023-10-06 10:13:13,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:13:13,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x1791fa74 to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:13:13,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24614132, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:13:13,439 DEBUG [hconnection-0x67848b62-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:13:13,444 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:13:13,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:13:13,453 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:13:13,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1791fa74 to 127.0.0.1:65169 2023-10-06 10:13:13,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:13:13,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-06 10:13:13,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:13:13,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 10:13:13,459 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:13:13,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 10:13:13,465 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 10:13:13,466 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696587793466 2023-10-06 10:13:13,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 10:13:13,470 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 10:13:13,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 10:13:13,470 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:13:13,470 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:13:13,471 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-10-06 10:13:13,473 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 10:13:13,474 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696587793474 2023-10-06 10:13:13,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,510 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-06 10:13:13,510 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:13:13,514 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-06 10:13:13,514 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-06 10:13:13,560 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,560 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,562 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:13,562 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:13,562 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:13,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:13,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:13,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:13,562 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-06 10:13:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 10:13:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-06 10:13:13,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,564 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 10:13:13,564 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:13:13,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 10:13:13,564 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:13,565 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:13,565 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:13,565 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:13:13,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-06 10:13:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,568 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 10:13:13,568 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 10:13:13,568 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:13:13,567 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 10:13:13,569 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 10:13:13,569 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 10:13:13,571 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:13:13,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 10:13:13,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:13:13,572 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:13:13,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,575 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 10:13:13,575 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:13:13,578 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,580 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,581 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:13:13,590 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 10:13:13,590 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 10:13:13,590 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 10:13:13,590 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 10:13:13,590 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 10:13:13,590 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 10:13:13,593 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:13,593 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:13,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:13,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:13,593 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:13,594 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:13,594 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,594 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:13:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:13,594 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,594 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:13:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:13,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 10:13:13,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f1ad60[Count = 1] remaining members to acquire global barrier 2023-10-06 10:13:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:13,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 10:13:13,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f1ad60[Count = 0] remaining members to acquire global barrier 2023-10-06 10:13:13,602 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-06 10:13:13,602 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,602 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,602 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,602 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,603 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 10:13:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,603 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,603 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 10:13:13,603 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 10:13:13,603 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:13:13,603 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 10:13:13,604 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 10:13:13,604 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:13:13,604 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 10:13:13,604 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:13,605 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:13:13,605 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:13:13,609 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:13:13,609 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:13,609 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:13:13,609 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:13:13,609 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. started... 2023-10-06 10:13:13,609 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d5a2c23360941e2243df0f2a41b562c: 2023-10-06 10:13:13,610 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,610 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:13:13,610 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:13:13,613 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:13,613 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. started... 2023-10-06 10:13:13,615 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dd88f4c1b807ccea93292791255cc77: 2023-10-06 10:13:13,615 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:13,615 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:13:13,615 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 10:13:13,773 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:13:13,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 10:13:13,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:13:13,774 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 10:13:14,061 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. completed. 2023-10-06 10:13:14,062 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:14,062 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. completed. 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:13:14,062 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 10:13:14,062 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:13:14,063 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 10:13:14,064 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:13:14,064 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,064 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 10:13:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:14,066 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,066 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 10:13:14,066 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:13:14,066 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 10:13:14,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:14,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:14,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:14,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,36349,1696587032478': 2023-10-06 10:13:14,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-06 10:13:14,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:14,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:14,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:14,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:14,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,074 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:13:14,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 10:13:14,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:13:14,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:14,075 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-06 10:13:14,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:13:14,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-06 10:13:14,076 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-06 10:13:14,077 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:13:14,077 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:13:14,077 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,077 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:13:14,078 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,078 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,078 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,078 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,078 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,078 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,078 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:14,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,080 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,081 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:14,081 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:14,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,084 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,084 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,084 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,087 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,087 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:14,087 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:14,087 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:14,087 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,087 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:14,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:14,088 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:14,088 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,088 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:14,087 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:14,088 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,088 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:13:14,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:14,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:13:14,088 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,090 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,090 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,090 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,090 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,090 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 10:13:14,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-06 10:13:14,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,170 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696587193466Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696587194111 (+645 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696587194111Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696587194111Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696587194118 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696587194162 (+44 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696587194170 (+8 ms) 2023-10-06 10:13:14,182 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 10:13:14,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 714 msec 2023-10-06 10:13:14,575 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:13:14,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 10:13:14,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:13:14,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40269] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:13:14,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36349] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 10:13:14,598 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,598 DEBUG [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:14,598 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 10:13:14,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 10:13:14,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696587194629 (current time:1696587194629). 2023-10-06 10:13:14,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 10:13:14,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x18142d3e to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:13:14,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a156e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:13:14,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:13:14,643 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:13:14,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18142d3e to 127.0.0.1:65169 2023-10-06 10:13:14,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:13:14,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(139): Connect 0x33a2b9db to 127.0.0.1:65169 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 10:13:14,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ae60f4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 10:13:14,669 DEBUG [hconnection-0x12686699-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:13:14,675 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:13:14,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 10:13:14,693 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 10:13:14,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33a2b9db to 127.0.0.1:65169 2023-10-06 10:13:14,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:13:14,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-06 10:13:14,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 10:13:14,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 10:13:14,698 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot, current working dir path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 10:13:14,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 10:13:14,701 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 10:13:14,702 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696587794702 2023-10-06 10:13:14,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 10:13:14,703 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 10:13:14,703 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 10:13:14,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,706 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 10:13:14,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 10:13:14,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-10-06 10:13:14,711 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 10:13:14,712 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696587794712 2023-10-06 10:13:14,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,738 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-06 10:13:14,738 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:13:14,740 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-06 10:13:14,740 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-06 10:13:14,740 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,740 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,741 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:14,741 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:14,741 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:14,741 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:14,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:14,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:14,741 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,742 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,742 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,742 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 10:13:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-06 10:13:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-06 10:13:14,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-06 10:13:14,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,743 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 10:13:14,743 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 10:13:14,743 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 10:13:14,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,749 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 10:13:14,749 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:13:14,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,749 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 10:13:14,749 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:13:14,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,758 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 10:13:14,758 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 10:13:14,758 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 10:13:14,758 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 10:13:14,758 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 10:13:14,759 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44159,1696587032316' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 10:13:14,760 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,760 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,760 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:14,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:14,760 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,760 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:13:14,760 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:14,760 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:13:14,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:14,761 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 10:13:14,761 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 10:13:14,762 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 10:13:14,762 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 10:13:14,762 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 10:13:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,765 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,765 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,765 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:14,765 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 10:13:14,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,40269,1696587032407' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 10:13:14,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@141c7dd5[Count = 1] remaining members to acquire global barrier 2023-10-06 10:13:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:14,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36349,1696587032478' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 10:13:14,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@141c7dd5[Count = 0] remaining members to acquire global barrier 2023-10-06 10:13:14,767 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-06 10:13:14,768 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,768 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,768 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,768 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,768 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 10:13:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,769 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 10:13:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,769 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:13:14,769 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:13:14,769 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 10:13:14,769 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,769 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:14,769 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:14,769 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 10:13:14,769 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 10:13:14,769 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 10:13:14,769 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,769 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 10:13:14,769 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,44159,1696587032316' in zk 2023-10-06 10:13:14,769 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. started... 2023-10-06 10:13:14,769 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. started... 2023-10-06 10:13:14,769 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4d5a2c23360941e2243df0f2a41b562c 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-06 10:13:14,769 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9dd88f4c1b807ccea93292791255cc77 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-06 10:13:14,770 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 10:13:14,770 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:13:14,770 DEBUG [member: 'jenkins-hbase17.apache.org,44159,1696587032316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 10:13:14,803 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006f9b461e82e204adba596e8e574567203 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006f9b461e82e204adba596e8e574567203 2023-10-06 10:13:14,803 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:13:14,804 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310060244d24c9c904a64846928a4c22d6546 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310060244d24c9c904a64846928a4c22d6546 2023-10-06 10:13:14,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 10:13:14,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-06 10:13:14,805 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 10:13:14,815 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/.tmp/cf/be90b502e1be4d869d1368f640ae5319 2023-10-06 10:13:14,816 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/.tmp/cf/47fb730059e749f1a23fb0aa86f4b552 2023-10-06 10:13:14,821 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/.tmp/cf/be90b502e1be4d869d1368f640ae5319 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/cf/be90b502e1be4d869d1368f640ae5319 2023-10-06 10:13:14,821 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/.tmp/cf/47fb730059e749f1a23fb0aa86f4b552 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/cf/47fb730059e749f1a23fb0aa86f4b552 2023-10-06 10:13:14,827 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/cf/be90b502e1be4d869d1368f640ae5319, entries=4, sequenceid=6, filesize=5.6 K 2023-10-06 10:13:14,828 INFO [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 4d5a2c23360941e2243df0f2a41b562c in 59ms, sequenceid=6, compaction requested=false 2023-10-06 10:13:14,829 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-06 10:13:14,829 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/cf/47fb730059e749f1a23fb0aa86f4b552, entries=46, sequenceid=6, filesize=13.2 K 2023-10-06 10:13:14,829 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d5a2c23360941e2243df0f2a41b562c: 2023-10-06 10:13:14,829 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,829 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:13:14,829 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/cf/be90b502e1be4d869d1368f640ae5319] hfiles 2023-10-06 10:13:14,830 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/cf/be90b502e1be4d869d1368f640ae5319 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,830 INFO [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9dd88f4c1b807ccea93292791255cc77 in 60ms, sequenceid=6, compaction requested=false 2023-10-06 10:13:14,831 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dd88f4c1b807ccea93292791255cc77: 2023-10-06 10:13:14,832 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,832 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 10:13:14,832 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/cf/47fb730059e749f1a23fb0aa86f4b552] hfiles 2023-10-06 10:13:14,832 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/cf/47fb730059e749f1a23fb0aa86f4b552 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,839 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. completed. 2023-10-06 10:13:14,839 DEBUG [rs(jenkins-hbase17.apache.org,40269,1696587032407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,839 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. completed. 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,40269,1696587032407' in zk 2023-10-06 10:13:14,839 DEBUG [rs(jenkins-hbase17.apache.org,36349,1696587032478)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 10:13:14,839 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,36349,1696587032478' in zk 2023-10-06 10:13:14,840 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,840 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 10:13:14,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:14,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:14,840 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:13:14,840 DEBUG [member: 'jenkins-hbase17.apache.org,40269,1696587032407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 10:13:14,842 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:14,843 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 10:13:14,843 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:13:14,843 DEBUG [member: 'jenkins-hbase17.apache.org,36349,1696587032478' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 10:13:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:14,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,40269,1696587032407': 2023-10-06 10:13:14,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,40269,1696587032407' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-06 10:13:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:14,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,36349,1696587032478': 2023-10-06 10:13:14,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36349,1696587032478' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-06 10:13:14,852 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-06 10:13:14,853 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 10:13:14,853 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 10:13:14,853 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,853 INFO [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 10:13:14,854 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 10:13:14,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 10:13:14,854 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 10:13:14,854 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,854 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,856 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 10:13:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,856 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 10:13:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,858 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,858 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,858 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:14,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:14,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 10:13:14,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 10:13:14,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,861 DEBUG [(jenkins-hbase17.apache.org,45845,1696587030680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 10:13:14,861 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,862 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,863 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:14,863 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,863 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:14,863 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:14,863 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,863 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,861 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 10:13:14,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 10:13:14,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 10:13:14,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 10:13:14,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310060244d24c9c904a64846928a4c22d6546, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006f9b461e82e204adba596e8e574567203] mob files 2023-10-06 10:13:14,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310060244d24c9c904a64846928a4c22d6546 2023-10-06 10:13:14,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006f9b461e82e204adba596e8e574567203 2023-10-06 10:13:14,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-06 10:13:14,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,891 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:14,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696587194703Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696587194872 (+169 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696587194872Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696587194872Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696587194875 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696587194882 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696587194891 (+9 ms) 2023-10-06 10:13:14,895 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 10:13:14,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 190 msec 2023-10-06 10:13:15,005 DEBUG [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 10:13:15,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 10:13:15,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 10:13:15,006 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006 2023-10-06 10:13:15,006 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43027, tgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006, rawTgtDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006, srcFsUri=hdfs://localhost:43027, srcDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:13:15,036 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae 2023-10-06 10:13:15,036 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1321296311_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:15,036 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43027, inputRoot=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae, snapshotDir=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-06 10:13:15,045 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:15,534 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:15,535 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:15,535 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:15,535 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:16,354 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0006_000001 (auth:SIMPLE) 2023-10-06 10:13:16,442 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-2520065235708539121.jar 2023-10-06 10:13:16,443 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:16,443 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:16,525 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/hadoop-3819993855329706935.jar 2023-10-06 10:13:16,525 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:16,526 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:16,526 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:16,527 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:16,527 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:16,527 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 10:13:16,528 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-06 10:13:16,528 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-06 10:13:16,528 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-06 10:13:16,529 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-06 10:13:16,529 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-06 10:13:16,530 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 10:13:16,530 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 10:13:16,530 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 10:13:16,530 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 10:13:16,531 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 10:13:16,531 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:13:16,532 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:13:16,532 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:13:16,532 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:13:16,533 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 10:13:16,533 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:13:16,534 DEBUG [Listener at jenkins-hbase17.apache.org/42055] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 10:13:17,441 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 10:13:17,610 WARN [Listener at jenkins-hbase17.apache.org/42055] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 10:13:17,612 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-06 10:13:17,614 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-06 10:13:17,783 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:13:17,783 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 10:13:17,919 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0007_000001 (auth:SIMPLE) 2023-10-06 10:13:23,079 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0007_000001 (auth:SIMPLE) 2023-10-06 10:13:25,406 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0007_000001 (auth:SIMPLE) 2023-10-06 10:13:29,624 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696587045125_0007_000001 (auth:SIMPLE) 2023-10-06 10:13:30,921 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 10:13:30,921 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 10:13:30,944 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:30,944 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 10:13:30,946 INFO [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 10:13:30,946 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:30,949 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-06 10:13:30,949 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-06 10:13:30,950 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-600076826_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:30,952 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-06 10:13:30,952 DEBUG [Listener at jenkins-hbase17.apache.org/42055] snapshot.TestExportSnapshot(367): hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/export-test/export-1696587195006/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-06 10:13:30,958 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:30,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:30,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:30,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-06 10:13:30,967 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587210967"}]},"ts":"1696587210967"} 2023-10-06 10:13:30,969 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-06 10:13:30,970 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-06 10:13:30,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d5a2c23360941e2243df0f2a41b562c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9dd88f4c1b807ccea93292791255cc77, UNASSIGN}] 2023-10-06 10:13:30,973 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d5a2c23360941e2243df0f2a41b562c, UNASSIGN 2023-10-06 10:13:30,973 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9dd88f4c1b807ccea93292791255cc77, UNASSIGN 2023-10-06 10:13:30,974 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4d5a2c23360941e2243df0f2a41b562c, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:30,974 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9dd88f4c1b807ccea93292791255cc77, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:30,974 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587210974"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587210974"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587210974"}]},"ts":"1696587210974"} 2023-10-06 10:13:30,974 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587210974"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696587210974"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696587210974"}]},"ts":"1696587210974"} 2023-10-06 10:13:30,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 4d5a2c23360941e2243df0f2a41b562c, server=jenkins-hbase17.apache.org,40269,1696587032407}] 2023-10-06 10:13:30,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 9dd88f4c1b807ccea93292791255cc77, server=jenkins-hbase17.apache.org,36349,1696587032478}] 2023-10-06 10:13:31,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-06 10:13:31,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:31,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4d5a2c23360941e2243df0f2a41b562c, disabling compactions & flushes 2023-10-06 10:13:31,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:31,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:31,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. after waiting 0 ms 2023-10-06 10:13:31,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:31,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:31,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 9dd88f4c1b807ccea93292791255cc77, disabling compactions & flushes 2023-10-06 10:13:31,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:31,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:31,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. after waiting 0 ms 2023-10-06 10:13:31,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:31,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:13:31,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:13:31,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:13:31,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77. 2023-10-06 10:13:31,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 9dd88f4c1b807ccea93292791255cc77: 2023-10-06 10:13:31,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:13:31,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c. 2023-10-06 10:13:31,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4d5a2c23360941e2243df0f2a41b562c: 2023-10-06 10:13:31,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:31,182 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9dd88f4c1b807ccea93292791255cc77, regionState=CLOSED 2023-10-06 10:13:31,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:31,182 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587211182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587211182"}]},"ts":"1696587211182"} 2023-10-06 10:13:31,182 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4d5a2c23360941e2243df0f2a41b562c, regionState=CLOSED 2023-10-06 10:13:31,182 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696587211182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696587211182"}]},"ts":"1696587211182"} 2023-10-06 10:13:31,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-06 10:13:31,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 9dd88f4c1b807ccea93292791255cc77, server=jenkins-hbase17.apache.org,36349,1696587032478 in 208 msec 2023-10-06 10:13:31,189 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9dd88f4c1b807ccea93292791255cc77, UNASSIGN in 217 msec 2023-10-06 10:13:31,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-06 10:13:31,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 4d5a2c23360941e2243df0f2a41b562c, server=jenkins-hbase17.apache.org,40269,1696587032407 in 213 msec 2023-10-06 10:13:31,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-10-06 10:13:31,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4d5a2c23360941e2243df0f2a41b562c, UNASSIGN in 220 msec 2023-10-06 10:13:31,195 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696587211195"}]},"ts":"1696587211195"} 2023-10-06 10:13:31,196 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-06 10:13:31,197 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-06 10:13:31,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 239 msec 2023-10-06 10:13:31,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-06 10:13:31,266 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-06 10:13:31,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,271 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,272 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,274 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44159] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,275 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,276 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,276 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,276 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 10:13:31,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 10:13:31,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 10:13:31,276 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 10:13:31,277 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,277 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,277 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:31,277 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,277 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:31,277 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:31,277 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,277 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 10:13:31,278 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:31,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-06 10:13:31,281 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:31,283 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/recovered.edits] 2023-10-06 10:13:31,283 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/cf, FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/recovered.edits] 2023-10-06 10:13:31,287 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/cf/47fb730059e749f1a23fb0aa86f4b552 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/cf/47fb730059e749f1a23fb0aa86f4b552 2023-10-06 10:13:31,287 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/cf/be90b502e1be4d869d1368f640ae5319 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/cf/be90b502e1be4d869d1368f640ae5319 2023-10-06 10:13:31,292 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77/recovered.edits/9.seqid 2023-10-06 10:13:31,294 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9dd88f4c1b807ccea93292791255cc77 2023-10-06 10:13:31,297 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/recovered.edits/9.seqid to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c/recovered.edits/9.seqid 2023-10-06 10:13:31,303 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4d5a2c23360941e2243df0f2a41b562c 2023-10-06 10:13:31,303 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-06 10:13:31,308 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-06 10:13:31,308 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-06 10:13:31,311 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310060244d24c9c904a64846928a4c22d6546 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310060244d24c9c904a64846928a4c22d6546 2023-10-06 10:13:31,313 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006f9b461e82e204adba596e8e574567203 to hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006f9b461e82e204adba596e8e574567203 2023-10-06 10:13:31,313 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-06 10:13:31,318 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,330 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-06 10:13:31,333 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-06 10:13:31,335 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,335 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-06 10:13:31,335 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587211335"}]},"ts":"9223372036854775807"} 2023-10-06 10:13:31,335 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696587211335"}]},"ts":"9223372036854775807"} 2023-10-06 10:13:31,337 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 10:13:31,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4d5a2c23360941e2243df0f2a41b562c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696587192136.4d5a2c23360941e2243df0f2a41b562c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9dd88f4c1b807ccea93292791255cc77, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696587192136.9dd88f4c1b807ccea93292791255cc77.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 10:13:31,337 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-06 10:13:31,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696587211337"}]},"ts":"9223372036854775807"} 2023-10-06 10:13:31,346 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-06 10:13:31,347 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 80 msec 2023-10-06 10:13:31,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-06 10:13:31,380 INFO [Listener at jenkins-hbase17.apache.org/42055] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-06 10:13:31,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-06 10:13:31,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-06 10:13:31,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45845] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 10:13:31,422 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 764), OpenFileDescriptor=914 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1015 (was 1007) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 192), AvailableMemoryMB=1921 (was 3385) 2023-10-06 10:13:31,422 WARN [Listener at jenkins-hbase17.apache.org/42055] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-06 10:13:31,422 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-06 10:13:31,443 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-10-06 10:13:31,559 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696587045125_0007_01_000001 is : 143 2023-10-06 10:13:36,776 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 10:13:45,572 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-10-06 10:13:59,696 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-06 10:13:59,697 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-10-06 10:13:59,812 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-06 10:13:59,823 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-06 10:13:59,826 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-06 10:13:59,855 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-10-06 10:13:59,963 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-06 10:13:59,963 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-06 10:13:59,963 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-06 10:13:59,963 INFO [Listener at jenkins-hbase17.apache.org/42055] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-06 10:13:59,963 DEBUG [Listener at jenkins-hbase17.apache.org/42055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4423e4e4 to 127.0.0.1:65169 2023-10-06 10:13:59,964 DEBUG [Listener at jenkins-hbase17.apache.org/42055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:13:59,968 DEBUG [Listener at jenkins-hbase17.apache.org/42055] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-06 10:13:59,969 DEBUG [Listener at jenkins-hbase17.apache.org/42055] util.JVMClusterUtil(257): Found active master hash=1250748449, stopped=false 2023-10-06 10:13:59,969 DEBUG [Listener at jenkins-hbase17.apache.org/42055] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:13:59,969 DEBUG [Listener at jenkins-hbase17.apache.org/42055] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-06 10:13:59,969 INFO [Listener at jenkins-hbase17.apache.org/42055] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:13:59,970 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 10:13:59,970 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 10:13:59,970 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 10:13:59,971 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 10:13:59,971 INFO [Listener at jenkins-hbase17.apache.org/42055] procedure2.ProcedureExecutor(628): Stopping 2023-10-06 10:13:59,971 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:13:59,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 10:13:59,971 DEBUG [Listener at jenkins-hbase17.apache.org/42055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60b6a908 to 127.0.0.1:65169 2023-10-06 10:13:59,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 10:13:59,971 DEBUG [Listener at jenkins-hbase17.apache.org/42055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:13:59,971 INFO [Listener at jenkins-hbase17.apache.org/42055] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,44159,1696587032316' ***** 2023-10-06 10:13:59,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 10:13:59,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 10:13:59,972 DEBUG [Listener at jenkins-hbase17.apache.org/42055] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:13:59,980 INFO [Listener at jenkins-hbase17.apache.org/42055] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-06 10:13:59,980 INFO [RS:0;jenkins-hbase17:44159] regionserver.HeapMemoryManager(220): Stopping 2023-10-06 10:13:59,980 INFO [RS:0;jenkins-hbase17:44159] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-06 10:13:59,980 INFO [RS:0;jenkins-hbase17:44159] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-06 10:13:59,981 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(3305): Received CLOSE for 9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:13:59,981 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:13:59,981 DEBUG [RS:0;jenkins-hbase17:44159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62f1e446 to 127.0.0.1:65169 2023-10-06 10:13:59,981 DEBUG [RS:0;jenkins-hbase17:44159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:13:59,984 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-06 10:13:59,984 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1478): Online Regions={9173fcba91788b7e6bc21028bb748f50=hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50.} 2023-10-06 10:13:59,980 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-06 10:13:59,985 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-06 10:13:59,985 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1504): Waiting on 9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:13:59,986 INFO [Listener at jenkins-hbase17.apache.org/42055] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,40269,1696587032407' ***** 2023-10-06 10:13:59,987 DEBUG [Listener at jenkins-hbase17.apache.org/42055] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:13:59,987 INFO [Listener at jenkins-hbase17.apache.org/42055] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-06 10:13:59,987 INFO [Listener at jenkins-hbase17.apache.org/42055] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,36349,1696587032478' ***** 2023-10-06 10:13:59,987 DEBUG [Listener at jenkins-hbase17.apache.org/42055] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:13:59,987 INFO [Listener at jenkins-hbase17.apache.org/42055] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-06 10:13:59,987 INFO [RS:2;jenkins-hbase17:36349] regionserver.HeapMemoryManager(220): Stopping 2023-10-06 10:13:59,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 9173fcba91788b7e6bc21028bb748f50, disabling compactions & flushes 2023-10-06 10:13:59,987 INFO [RS:2;jenkins-hbase17:36349] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-06 10:13:59,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:13:59,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:13:59,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. after waiting 0 ms 2023-10-06 10:13:59,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:13:59,987 INFO [RS:2;jenkins-hbase17:36349] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-06 10:13:59,988 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(3305): Received CLOSE for 4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:13:59,988 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:13:59,988 INFO [RS:1;jenkins-hbase17:40269] regionserver.HeapMemoryManager(220): Stopping 2023-10-06 10:13:59,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 9173fcba91788b7e6bc21028bb748f50 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-06 10:13:59,988 INFO [RS:1;jenkins-hbase17:40269] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-06 10:13:59,988 INFO [RS:1;jenkins-hbase17:40269] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-06 10:13:59,988 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:13:59,988 DEBUG [RS:1;jenkins-hbase17:40269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65397fd3 to 127.0.0.1:65169 2023-10-06 10:13:59,989 DEBUG [RS:1;jenkins-hbase17:40269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:13:59,989 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-06 10:13:59,987 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-06 10:13:59,989 DEBUG [RS:2;jenkins-hbase17:36349] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c125899 to 127.0.0.1:65169 2023-10-06 10:13:59,989 DEBUG [RS:2;jenkins-hbase17:36349] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:13:59,992 INFO [RS:1;jenkins-hbase17:40269] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-06 10:13:59,992 INFO [RS:1;jenkins-hbase17:40269] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-06 10:13:59,992 INFO [RS:1;jenkins-hbase17:40269] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-06 10:13:59,992 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-06 10:13:59,993 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-06 10:13:59,993 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1478): Online Regions={4276fc4bac3c2b6c02ad86b156998670=hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670.} 2023-10-06 10:13:59,993 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1504): Waiting on 4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:13:59,993 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-06 10:13:59,994 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-06 10:13:59,995 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-06 10:13:59,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4276fc4bac3c2b6c02ad86b156998670, disabling compactions & flushes 2023-10-06 10:13:59,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-06 10:13:59,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-06 10:13:59,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-06 10:13:59,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-06 10:13:59,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-06 10:13:59,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-10-06 10:13:59,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:13:59,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:13:59,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. after waiting 0 ms 2023-10-06 10:13:59,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:13:59,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 4276fc4bac3c2b6c02ad86b156998670 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-06 10:14:00,012 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-06 10:14:00,061 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-06 10:14:00,190 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1504): Waiting on 9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:14:00,193 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1504): Waiting on 4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:14:00,197 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-06 10:14:00,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50/.tmp/l/01bb505dec164700bcdf0e57f4e333be 2023-10-06 10:14:00,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670/.tmp/info/2b092ce8a7034e6d9d456424e76e2087 2023-10-06 10:14:00,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01bb505dec164700bcdf0e57f4e333be 2023-10-06 10:14:00,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50/.tmp/l/01bb505dec164700bcdf0e57f4e333be as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50/l/01bb505dec164700bcdf0e57f4e333be 2023-10-06 10:14:00,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/.tmp/info/a7514669b67e4854b446e77125ba32d0 2023-10-06 10:14:00,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670/.tmp/info/2b092ce8a7034e6d9d456424e76e2087 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670/info/2b092ce8a7034e6d9d456424e76e2087 2023-10-06 10:14:00,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01bb505dec164700bcdf0e57f4e333be 2023-10-06 10:14:00,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50/l/01bb505dec164700bcdf0e57f4e333be, entries=7, sequenceid=18, filesize=5.2 K 2023-10-06 10:14:00,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 9173fcba91788b7e6bc21028bb748f50 in 385ms, sequenceid=18, compaction requested=false 2023-10-06 10:14:00,386 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7514669b67e4854b446e77125ba32d0 2023-10-06 10:14:00,392 DEBUG [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1504): Waiting on 9173fcba91788b7e6bc21028bb748f50 2023-10-06 10:14:00,394 DEBUG [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1504): Waiting on 4276fc4bac3c2b6c02ad86b156998670 2023-10-06 10:14:00,397 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-06 10:14:00,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670/info/2b092ce8a7034e6d9d456424e76e2087, entries=2, sequenceid=6, filesize=4.8 K 2023-10-06 10:14:00,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4276fc4bac3c2b6c02ad86b156998670 in 412ms, sequenceid=6, compaction requested=false 2023-10-06 10:14:00,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/acl/9173fcba91788b7e6bc21028bb748f50/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-06 10:14:00,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:14:00,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:14:00,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 9173fcba91788b7e6bc21028bb748f50: 2023-10-06 10:14:00,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696587038773.9173fcba91788b7e6bc21028bb748f50. 2023-10-06 10:14:00,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/namespace/4276fc4bac3c2b6c02ad86b156998670/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 10:14:00,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:14:00,545 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/.tmp/rep_barrier/094db603aec241c986ebb23c4005d486 2023-10-06 10:14:00,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:14:00,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4276fc4bac3c2b6c02ad86b156998670: 2023-10-06 10:14:00,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696587037334.4276fc4bac3c2b6c02ad86b156998670. 2023-10-06 10:14:00,570 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 094db603aec241c986ebb23c4005d486 2023-10-06 10:14:00,593 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,44159,1696587032316; all regions closed. 2023-10-06 10:14:00,596 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,36349,1696587032478; all regions closed. 2023-10-06 10:14:00,601 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-06 10:14:00,697 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/WALs/jenkins-hbase17.apache.org,44159,1696587032316/jenkins-hbase17.apache.org%2C44159%2C1696587032316.1696587036026 not finished, retry = 0 2023-10-06 10:14:00,697 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/.tmp/table/279f3072e0f044cfad7aaa82cb159b89 2023-10-06 10:14:00,719 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 279f3072e0f044cfad7aaa82cb159b89 2023-10-06 10:14:00,721 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/.tmp/info/a7514669b67e4854b446e77125ba32d0 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/info/a7514669b67e4854b446e77125ba32d0 2023-10-06 10:14:00,725 DEBUG [RS:2;jenkins-hbase17:36349] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/oldWALs 2023-10-06 10:14:00,725 INFO [RS:2;jenkins-hbase17:36349] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C36349%2C1696587032478:(num 1696587036015) 2023-10-06 10:14:00,725 DEBUG [RS:2;jenkins-hbase17:36349] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:14:00,726 INFO [RS:2;jenkins-hbase17:36349] regionserver.LeaseManager(133): Closed leases 2023-10-06 10:14:00,726 INFO [RS:2;jenkins-hbase17:36349] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-06 10:14:00,726 INFO [RS:2;jenkins-hbase17:36349] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-06 10:14:00,726 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 10:14:00,726 INFO [RS:2;jenkins-hbase17:36349] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-06 10:14:00,727 INFO [RS:2;jenkins-hbase17:36349] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-06 10:14:00,737 INFO [RS:2;jenkins-hbase17:36349] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:36349 2023-10-06 10:14:00,746 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:14:00,746 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 10:14:00,747 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:14:00,747 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 10:14:00,748 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 10:14:00,748 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,36349,1696587032478] 2023-10-06 10:14:00,751 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,36349,1696587032478; numProcessing=1 2023-10-06 10:14:00,752 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,36349,1696587032478 2023-10-06 10:14:00,752 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 10:14:00,752 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7514669b67e4854b446e77125ba32d0 2023-10-06 10:14:00,752 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/info/a7514669b67e4854b446e77125ba32d0, entries=48, sequenceid=131, filesize=10.3 K 2023-10-06 10:14:00,753 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,36349,1696587032478 already deleted, retry=false 2023-10-06 10:14:00,754 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,36349,1696587032478 expired; onlineServers=2 2023-10-06 10:14:00,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/.tmp/rep_barrier/094db603aec241c986ebb23c4005d486 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/rep_barrier/094db603aec241c986ebb23c4005d486 2023-10-06 10:14:00,791 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 094db603aec241c986ebb23c4005d486 2023-10-06 10:14:00,791 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/rep_barrier/094db603aec241c986ebb23c4005d486, entries=13, sequenceid=131, filesize=6.4 K 2023-10-06 10:14:00,798 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/.tmp/table/279f3072e0f044cfad7aaa82cb159b89 as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/table/279f3072e0f044cfad7aaa82cb159b89 2023-10-06 10:14:00,800 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-06 10:14:00,800 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-06 10:14:00,801 DEBUG [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-06 10:14:00,818 DEBUG [RS:0;jenkins-hbase17:44159] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/oldWALs 2023-10-06 10:14:00,818 INFO [RS:0;jenkins-hbase17:44159] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C44159%2C1696587032316:(num 1696587036026) 2023-10-06 10:14:00,818 DEBUG [RS:0;jenkins-hbase17:44159] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:14:00,818 INFO [RS:0;jenkins-hbase17:44159] regionserver.LeaseManager(133): Closed leases 2023-10-06 10:14:00,821 INFO [RS:0;jenkins-hbase17:44159] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-06 10:14:00,824 INFO [RS:0;jenkins-hbase17:44159] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-06 10:14:00,824 INFO [RS:0;jenkins-hbase17:44159] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-06 10:14:00,825 INFO [RS:0;jenkins-hbase17:44159] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-06 10:14:00,825 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 10:14:00,826 INFO [RS:0;jenkins-hbase17:44159] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:44159 2023-10-06 10:14:00,837 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 279f3072e0f044cfad7aaa82cb159b89 2023-10-06 10:14:00,837 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/table/279f3072e0f044cfad7aaa82cb159b89, entries=24, sequenceid=131, filesize=6.9 K 2023-10-06 10:14:00,845 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 849ms, sequenceid=131, compaction requested=false 2023-10-06 10:14:00,861 INFO [RS:2;jenkins-hbase17:36349] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,36349,1696587032478; zookeeper connection closed. 2023-10-06 10:14:00,863 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 10:14:00,863 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:36349-0x1011b35d7160003, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 10:14:00,866 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a0cb446] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a0cb446 2023-10-06 10:14:00,869 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 10:14:00,870 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:14:00,870 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44159,1696587032316 2023-10-06 10:14:00,877 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,44159,1696587032316] 2023-10-06 10:14:00,877 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,44159,1696587032316; numProcessing=2 2023-10-06 10:14:00,879 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,44159,1696587032316 already deleted, retry=false 2023-10-06 10:14:00,879 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,44159,1696587032316 expired; onlineServers=1 2023-10-06 10:14:00,909 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:14:00,909 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:14:00,909 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-06 10:14:00,933 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-06 10:14:00,936 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 10:14:00,936 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-06 10:14:00,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-06 10:14:00,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-06 10:14:00,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-06 10:14:00,978 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 10:14:00,978 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:44159-0x1011b35d7160001, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 10:14:00,978 INFO [RS:0;jenkins-hbase17:44159] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,44159,1696587032316; zookeeper connection closed. 2023-10-06 10:14:00,985 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4bbe9654] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4bbe9654 2023-10-06 10:14:01,001 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,40269,1696587032407; all regions closed. 2023-10-06 10:14:01,018 DEBUG [RS:1;jenkins-hbase17:40269] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/oldWALs 2023-10-06 10:14:01,018 INFO [RS:1;jenkins-hbase17:40269] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C40269%2C1696587032407.meta:.meta(num 1696587036627) 2023-10-06 10:14:01,041 DEBUG [RS:1;jenkins-hbase17:40269] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/oldWALs 2023-10-06 10:14:01,041 INFO [RS:1;jenkins-hbase17:40269] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C40269%2C1696587032407:(num 1696587036035) 2023-10-06 10:14:01,041 DEBUG [RS:1;jenkins-hbase17:40269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:14:01,041 INFO [RS:1;jenkins-hbase17:40269] regionserver.LeaseManager(133): Closed leases 2023-10-06 10:14:01,042 INFO [RS:1;jenkins-hbase17:40269] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-06 10:14:01,042 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 10:14:01,043 INFO [RS:1;jenkins-hbase17:40269] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:40269 2023-10-06 10:14:01,045 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 10:14:01,045 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,40269,1696587032407 2023-10-06 10:14:01,046 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,40269,1696587032407] 2023-10-06 10:14:01,046 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,40269,1696587032407; numProcessing=3 2023-10-06 10:14:01,051 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,40269,1696587032407 already deleted, retry=false 2023-10-06 10:14:01,052 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,40269,1696587032407 expired; onlineServers=0 2023-10-06 10:14:01,052 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,45845,1696587030680' ***** 2023-10-06 10:14:01,052 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-06 10:14:01,052 DEBUG [M:0;jenkins-hbase17:45845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bb1e21a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-10-06 10:14:01,052 INFO [M:0;jenkins-hbase17:45845] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,45845,1696587030680 2023-10-06 10:14:01,052 INFO [M:0;jenkins-hbase17:45845] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,45845,1696587030680; all regions closed. 2023-10-06 10:14:01,052 DEBUG [M:0;jenkins-hbase17:45845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 10:14:01,052 DEBUG [M:0;jenkins-hbase17:45845] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-06 10:14:01,052 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-06 10:14:01,052 DEBUG [M:0;jenkins-hbase17:45845] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-06 10:14:01,052 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1696587035430] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1696587035430,5,FailOnTimeoutGroup] 2023-10-06 10:14:01,053 INFO [M:0;jenkins-hbase17:45845] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-06 10:14:01,053 INFO [M:0;jenkins-hbase17:45845] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-06 10:14:01,053 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1696587035437] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1696587035437,5,FailOnTimeoutGroup] 2023-10-06 10:14:01,053 INFO [M:0;jenkins-hbase17:45845] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-10-06 10:14:01,053 DEBUG [M:0;jenkins-hbase17:45845] master.HMaster(1512): Stopping service threads 2023-10-06 10:14:01,053 INFO [M:0;jenkins-hbase17:45845] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-06 10:14:01,054 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-06 10:14:01,054 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 10:14:01,054 ERROR [M:0;jenkins-hbase17:45845] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-10-06 10:14:01,055 INFO [M:0;jenkins-hbase17:45845] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-06 10:14:01,055 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-06 10:14:01,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 10:14:01,058 DEBUG [M:0;jenkins-hbase17:45845] zookeeper.ZKUtil(398): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-06 10:14:01,058 WARN [M:0;jenkins-hbase17:45845] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-06 10:14:01,058 INFO [M:0;jenkins-hbase17:45845] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-06 10:14:01,058 INFO [M:0;jenkins-hbase17:45845] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-06 10:14:01,060 DEBUG [M:0;jenkins-hbase17:45845] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-06 10:14:01,060 INFO [M:0;jenkins-hbase17:45845] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 10:14:01,060 DEBUG [M:0;jenkins-hbase17:45845] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 10:14:01,060 DEBUG [M:0;jenkins-hbase17:45845] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-06 10:14:01,060 DEBUG [M:0;jenkins-hbase17:45845] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 10:14:01,060 INFO [M:0;jenkins-hbase17:45845] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.03 KB heapSize=452.28 KB 2023-10-06 10:14:01,148 INFO [M:0;jenkins-hbase17:45845] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.03 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5c3b6bbb290d4cd3b94bc738955a1dcb 2023-10-06 10:14:01,152 INFO [RS:1;jenkins-hbase17:40269] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,40269,1696587032407; zookeeper connection closed. 2023-10-06 10:14:01,153 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 10:14:01,153 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): regionserver:40269-0x1011b35d7160002, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 10:14:01,153 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2082928f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2082928f 2023-10-06 10:14:01,155 INFO [M:0;jenkins-hbase17:45845] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c3b6bbb290d4cd3b94bc738955a1dcb 2023-10-06 10:14:01,155 INFO [Listener at jenkins-hbase17.apache.org/42055] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-06 10:14:01,158 DEBUG [M:0;jenkins-hbase17:45845] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5c3b6bbb290d4cd3b94bc738955a1dcb as hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5c3b6bbb290d4cd3b94bc738955a1dcb 2023-10-06 10:14:01,168 INFO [M:0;jenkins-hbase17:45845] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c3b6bbb290d4cd3b94bc738955a1dcb 2023-10-06 10:14:01,168 INFO [M:0;jenkins-hbase17:45845] regionserver.HStore(1080): Added hdfs://localhost:43027/user/jenkins/test-data/ec4797c8-fb04-8166-97d8-641ce81da8ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5c3b6bbb290d4cd3b94bc738955a1dcb, entries=119, sequenceid=899, filesize=28.6 K 2023-10-06 10:14:01,169 INFO [M:0;jenkins-hbase17:45845] regionserver.HRegion(2948): Finished flush of dataSize ~376.03 KB/385051, heapSize ~452.27 KB/463120, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 109ms, sequenceid=899, compaction requested=false 2023-10-06 10:14:01,174 INFO [M:0;jenkins-hbase17:45845] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 10:14:01,174 DEBUG [M:0;jenkins-hbase17:45845] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-06 10:14:01,206 INFO [M:0;jenkins-hbase17:45845] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-06 10:14:01,207 INFO [M:0;jenkins-hbase17:45845] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:45845 2023-10-06 10:14:01,207 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 10:14:01,208 DEBUG [M:0;jenkins-hbase17:45845] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,45845,1696587030680 already deleted, retry=false 2023-10-06 10:14:01,310 INFO [M:0;jenkins-hbase17:45845] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,45845,1696587030680; zookeeper connection closed. 2023-10-06 10:14:01,310 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 10:14:01,310 DEBUG [Listener at localhost/42741-EventThread] zookeeper.ZKWatcher(600): master:45845-0x1011b35d7160000, quorum=127.0.0.1:65169, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 10:14:01,312 WARN [Listener at jenkins-hbase17.apache.org/42055] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-06 10:14:01,348 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 10:14:01,454 WARN [BP-1251716152-136.243.18.41-1696587025003 heartbeating to localhost/127.0.0.1:43027] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-06 10:14:01,454 WARN [BP-1251716152-136.243.18.41-1696587025003 heartbeating to localhost/127.0.0.1:43027] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1251716152-136.243.18.41-1696587025003 (Datanode Uuid f88e656c-6275-41b7-ab3d-88ba3d3aca17) service to localhost/127.0.0.1:43027 2023-10-06 10:14:01,456 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data5/current/BP-1251716152-136.243.18.41-1696587025003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 10:14:01,457 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data6/current/BP-1251716152-136.243.18.41-1696587025003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 10:14:01,467 WARN [Listener at jenkins-hbase17.apache.org/42055] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-06 10:14:01,489 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 10:14:01,490 WARN [1709130041@qtp-1789039432-0 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43549] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-10-06 10:14:01,490 WARN [1709130041@qtp-1789039432-0 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43549] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-10-06 10:14:01,598 WARN [BP-1251716152-136.243.18.41-1696587025003 heartbeating to localhost/127.0.0.1:43027] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-06 10:14:01,598 WARN [BP-1251716152-136.243.18.41-1696587025003 heartbeating to localhost/127.0.0.1:43027] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1251716152-136.243.18.41-1696587025003 (Datanode Uuid 1ca46460-86c1-40b3-978a-84abe7a0e706) service to localhost/127.0.0.1:43027 2023-10-06 10:14:01,599 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data3/current/BP-1251716152-136.243.18.41-1696587025003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 10:14:01,599 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data4/current/BP-1251716152-136.243.18.41-1696587025003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 10:14:01,603 WARN [Listener at jenkins-hbase17.apache.org/42055] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-06 10:14:01,634 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 10:14:01,660 WARN [BP-1251716152-136.243.18.41-1696587025003 heartbeating to localhost/127.0.0.1:43027] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-06 10:14:01,660 WARN [BP-1251716152-136.243.18.41-1696587025003 heartbeating to localhost/127.0.0.1:43027] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1251716152-136.243.18.41-1696587025003 (Datanode Uuid 8725cb7d-bdda-4a8c-a2c8-b0b1f13392af) service to localhost/127.0.0.1:43027 2023-10-06 10:14:01,661 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data1/current/BP-1251716152-136.243.18.41-1696587025003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 10:14:01,665 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1b3453e-d37b-85b6-bd09-245fc95f0b20/cluster_47b0e4ff-f21f-505a-76a6-1603cf56f5fa/dfs/data/data2/current/BP-1251716152-136.243.18.41-1696587025003] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 10:14:01,718 INFO [Listener at jenkins-hbase17.apache.org/42055] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 10:14:01,776 INFO [Listener at jenkins-hbase17.apache.org/42055] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-06 10:14:01,951 INFO [Listener at jenkins-hbase17.apache.org/42055] hbase.HBaseTestingUtility(1293): Minicluster is down